Aug 26 20:37:16 user nova-compute[73476]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 20:37:19 user nova-compute[73476]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73476) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 20:37:19 user nova-compute[73476]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73476) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 20:37:19 user nova-compute[73476]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73476) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 20:37:19 user nova-compute[73476]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 20:37:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:37:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:37:19 user nova-compute[73476]: INFO nova.virt.driver [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 20:37:19 user nova-compute[73476]: INFO nova.compute.provider_config [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] Acquiring lock "singleton_lock" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] Acquired lock "singleton_lock" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] Releasing lock "singleton_lock" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] Full set of CONF: {{(pid=73476) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ******************************************************************************** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] Configuration options gathered from: {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ================================================================================ {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] allow_resize_to_same_host      = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] arq_binding_timeout            = 300 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] backdoor_port                  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] backdoor_socket                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] block_device_allocate_retries  = 300 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] block_device_allocate_retries_interval = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cert                           = self.pem {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute_monitors               = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] config_dir                     = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] config_drive_format            = iso9660 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] config_source                  = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] console_host                   = user {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] control_exchange               = nova {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cpu_allocation_ratio           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] daemon                         = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] debug                          = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] default_access_ip_network_name = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] default_availability_zone      = nova {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] default_ephemeral_format       = ext4 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] default_green_pool_size        = 1000 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] default_schedule_zone          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] disk_allocation_ratio          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] enable_new_services            = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] enabled_ssl_apis               = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] flat_injected                  = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] force_config_drive             = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] force_raw_images               = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] graceful_shutdown_timeout      = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] heal_instance_info_cache_interval = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] host                           = user {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] instance_build_timeout         = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] instance_delete_interval       = 300 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] instance_name_template         = instance-%08x {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] instance_usage_audit           = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] instance_usage_audit_period    = month {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] internal_service_availability_zone = internal {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] key                            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] live_migration_retry_count     = 30 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] log_config_append              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] log_dir                        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] log_file                       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] log_options                    = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] log_rotate_interval            = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] log_rotate_interval_type       = days {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] log_rotation_type              = none {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] long_rpc_timeout               = 1800 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] max_concurrent_builds          = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] max_concurrent_live_migrations = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] max_concurrent_snapshots       = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] max_local_block_devices        = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] max_logfile_count              = 30 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] max_logfile_size_mb            = 200 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] maximum_instance_delete_attempts = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] metadata_listen                = 0.0.0.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] metadata_listen_port           = 8775 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] metadata_workers               = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] migrate_max_retries            = -1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] mkisofs_cmd                    = genisoimage {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] my_ip                          = 10.0.0.210 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] network_allocate_retries       = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] osapi_compute_listen_port      = 8774 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] osapi_compute_unique_server_name_scope =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] osapi_compute_workers          = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] password_length                = 12 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] periodic_enable                = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] periodic_fuzzy_delay           = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] pointer_model                  = ps2mouse {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] preallocate_images             = none {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] publish_errors                 = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] pybasedir                      = /opt/stack/nova {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ram_allocation_ratio           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] rate_limit_burst               = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] rate_limit_except_level        = CRITICAL {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] rate_limit_interval            = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] reboot_timeout                 = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] reclaim_instance_interval      = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] record                         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] reimage_timeout_per_gb         = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] report_interval                = 120 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] rescue_timeout                 = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] reserved_host_cpus             = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] reserved_host_disk_mb          = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] reserved_host_memory_mb        = 512 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] reserved_huge_pages            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] resize_confirm_window          = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] resize_fs_using_block_device   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] resume_guests_state_on_host_boot = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] rpc_response_timeout           = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] run_external_periodic_tasks    = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] running_deleted_instance_action = reap {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] running_deleted_instance_timeout = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler_instance_sync_interval = 120 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_down_time              = 720 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] servicegroup_driver            = db {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] shelved_offload_time           = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] shelved_poll_interval          = 3600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] shutdown_timeout               = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] source_is_ipv6                 = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ssl_only                       = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] state_path                     = /opt/stack/data/nova {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] sync_power_state_interval      = 600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] sync_power_state_pool_size     = 1000 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] syslog_log_facility            = LOG_USER {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] tempdir                        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] timeout_nbd                    = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] transport_url                  = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] update_resources_interval      = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] use_cow_images                 = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] use_eventlog                   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] use_journal                    = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] use_json                       = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] use_rootwrap_daemon            = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] use_stderr                     = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] use_syslog                     = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vcpu_pin_set                   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plugging_is_fatal          = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plugging_timeout           = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] virt_mkfs                      = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] volume_usage_poll_interval     = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] watch_log_file                 = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] web                            = /usr/share/spice-html5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_concurrency.disable_process_locking = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.auth_strategy              = keystone {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.compute_link_prefix        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.dhcp_domain                = novalocal {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.enable_instance_password   = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.glance_link_prefix         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.instance_list_per_project_cells = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.list_records_by_skipping_down_cells = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.local_metadata_per_cell    = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.max_limit                  = 1000 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.metadata_cache_expiration  = 15 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.neutron_default_tenant_id  = default {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.use_forwarded_for          = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.use_neutron_default_nets   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.vendordata_dynamic_targets = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.vendordata_jsonfile_path   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.backend_argument         = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.config_prefix            = cache.oslo {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.dead_timeout             = 60.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.debug_cache_backend      = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.enable_retry_client      = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.enable_socket_keepalive  = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.enabled                  = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.expiration_time          = 600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.hashclient_retry_attempts = 2 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_dead_retry      = 300 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_password        =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_sasl_enabled    = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.memcache_username        =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.proxies                  = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.retry_attempts           = 2 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.retry_delay              = 0.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.socket_keepalive_count   = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.socket_keepalive_idle    = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.socket_keepalive_interval = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.tls_allowed_ciphers      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.tls_cafile               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.tls_certfile             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.tls_enabled              = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cache.tls_keyfile              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.auth_section            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.auth_type               = password {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.cafile                  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.certfile                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.collect_timing          = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.cross_az_attach         = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.debug                   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.endpoint_template       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.http_retries            = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.insecure                = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.keyfile                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.os_region_name          = RegionOne {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.split_loggers           = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cinder.timeout                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.cpu_dedicated_set      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.cpu_shared_set         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.image_type_exclude_list = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.resource_provider_association_refresh = 300 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.shutdown_retry_interval = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] conductor.workers              = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] console.allowed_origins        = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] console.ssl_ciphers            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] console.ssl_minimum_version    = default {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] consoleauth.token_ttl          = 600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.cafile                  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.certfile                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.collect_timing          = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.connect_retries         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.connect_retry_delay     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.endpoint_override       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.insecure                = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.keyfile                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.max_version             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.min_version             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.region_name             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.service_name            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.service_type            = accelerator {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.split_loggers           = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.status_code_retries     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.status_code_retry_delay = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.timeout                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] cyborg.version                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.backend               = sqlalchemy {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.connection            = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.connection_debug      = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.connection_parameters =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.connection_recycle_time = 3600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.connection_trace      = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.db_inc_retry_interval = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.db_max_retries        = 20 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.db_max_retry_interval = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.db_retry_interval     = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.max_overflow          = 50 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.max_pool_size         = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.max_retries           = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.mysql_enable_ndb      = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.mysql_wsrep_sync_wait = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.pool_timeout          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.retry_interval        = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.slave_connection      = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] database.sqlite_synchronous    = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.backend           = sqlalchemy {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.connection        = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.connection_debug  = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.connection_parameters =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.connection_recycle_time = 3600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.connection_trace  = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.db_inc_retry_interval = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.db_max_retries    = 20 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.db_max_retry_interval = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.db_retry_interval = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.max_overflow      = 50 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.max_pool_size     = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.max_retries       = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.mysql_enable_ndb  = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.pool_timeout      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.retry_interval    = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.slave_connection  = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] api_database.sqlite_synchronous = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] devices.enabled_mdev_types     = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ephemeral_storage_encryption.enabled = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.api_servers             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.cafile                  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.certfile                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.collect_timing          = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.connect_retries         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.connect_retry_delay     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.debug                   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.default_trusted_certificate_ids = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.enable_certificate_validation = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.enable_rbd_download     = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.endpoint_override       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.insecure                = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.keyfile                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.max_version             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.min_version             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.num_retries             = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.rbd_ceph_conf           =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.rbd_connect_timeout     = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.rbd_pool                =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.rbd_user                =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.region_name             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.service_name            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.service_type            = image {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.split_loggers           = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.status_code_retries     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.status_code_retry_delay = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.timeout                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.verify_glance_signatures = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] glance.version                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] guestfs.debug                  = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.config_drive_cdrom      = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.config_drive_inject_password = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.enable_remotefx         = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.instances_path_share    =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.limit_cpu_features      = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.use_multipath_io        = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.vswitch_name            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] mks.enabled                    = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] image_cache.manager_interval   = 2400 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] image_cache.precache_concurrency = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] image_cache.remove_unused_base_images = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] image_cache.subdirectory_name  = _base {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.api_max_retries         = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.api_retry_interval      = 2 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.auth_section            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.auth_type               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.cafile                  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.certfile                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.collect_timing          = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.connect_retries         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.connect_retry_delay     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.endpoint_override       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.insecure                = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.keyfile                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.max_version             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.min_version             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.partition_key           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.peer_list               = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.region_name             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.serial_console_state_timeout = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.service_name            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.service_type            = baremetal {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.split_loggers           = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.status_code_retries     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.status_code_retry_delay = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.timeout                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ironic.version                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] key_manager.fixed_key          = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.barbican_api_version  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.barbican_endpoint     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.barbican_endpoint_type = public {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.barbican_region_name  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.cafile                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.certfile              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.collect_timing        = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.insecure              = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.keyfile               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.number_of_retries     = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.retry_delay           = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.send_service_user_token = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.split_loggers         = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.timeout               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.verify_ssl            = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican.verify_ssl_path       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican_service_user.auth_section = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican_service_user.auth_type = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican_service_user.cafile   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican_service_user.certfile = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican_service_user.collect_timing = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican_service_user.insecure = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican_service_user.keyfile  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican_service_user.split_loggers = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] barbican_service_user.timeout  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.approle_role_id          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.approle_secret_id        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.cafile                   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.certfile                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.collect_timing           = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.insecure                 = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.keyfile                  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.kv_mountpoint            = secret {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.kv_version               = 2 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.namespace                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.root_token_id            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.split_loggers            = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.ssl_ca_crt_file          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.timeout                  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.use_ssl                  = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.cafile                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.certfile              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.collect_timing        = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.connect_retries       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.connect_retry_delay   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.endpoint_override     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.insecure              = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.keyfile               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.max_version           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.min_version           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.region_name           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.service_name          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.service_type          = identity {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.split_loggers         = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.status_code_retries   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.status_code_retry_delay = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.timeout               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] keystone.version               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.connection_uri         =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.cpu_mode               = custom {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: WARNING oslo_config.cfg [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.cpu_power_governor_high = performance {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.cpu_power_management   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.device_detach_attempts = 8 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.device_detach_timeout  = 20 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.disk_cachemodes        = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.disk_prefix            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.enabled_perf_events    = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.file_backed_memory     = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.gid_maps               = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.hw_disk_discard        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.hw_machine_type        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.images_rbd_pool        = rbd {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.images_type            = default {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.images_volume_group    = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.inject_key             = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.inject_partition       = -2 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.inject_password        = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.iscsi_iface            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.iser_use_multipath     = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_downtime = 500 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_inbound_addr = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_scheme  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_timeout_action = abort {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_tunnelled = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: WARNING oslo_config.cfg [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 20:37:20 user nova-compute[73476]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 20:37:20 user nova-compute[73476]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 20:37:20 user nova-compute[73476]: and ``live_migration_inbound_addr`` respectively.
Aug 26 20:37:20 user nova-compute[73476]: ).  Its value may be silently ignored in the future.
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.live_migration_with_native_tls = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.max_queues             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.nfs_mount_options      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.num_pcie_ports         = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.pmem_namespaces        = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.quobyte_client_cfg     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rbd_secret_uuid        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rbd_user               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rescue_image_id        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rescue_kernel_id       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.rx_queue_size          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.smbfs_mount_options    =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.snapshot_compression   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.snapshot_image_format  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.sparse_logical_volumes = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.swtpm_enabled          = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.swtpm_group            = tss {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.swtpm_user             = tss {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.sysinfo_serial         = unique {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.tb_cache_size          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.tx_queue_size          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.uid_maps               = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.use_virtio_for_bridges = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.virt_type              = kvm {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.volume_clear           = zero {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.volume_clear_size      = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.volume_use_multipath   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.vzstorage_cache_path   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.auth_section           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.auth_type              = password {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.cafile                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.certfile               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.collect_timing         = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.connect_retries        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.connect_retry_delay    = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.default_floating_pool  = public {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.endpoint_override      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.extension_sync_interval = 600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.http_retries           = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.insecure               = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.keyfile                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.max_version            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.min_version            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.ovs_bridge             = br-int {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.physnets               = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.region_name            = RegionOne {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.service_metadata_proxy = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.service_name           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.service_type           = network {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.split_loggers          = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.status_code_retries    = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.status_code_retry_delay = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.timeout                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] neutron.version                = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] notifications.bdms_in_notifications = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] notifications.default_level    = INFO {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] notifications.notification_format = unversioned {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] notifications.notify_on_state_change = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] pci.alias                      = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] pci.device_spec                = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] pci.report_in_placement        = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.auth_section         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.auth_type            = password {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.cafile               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.certfile             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.collect_timing       = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.connect_retries      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.connect_retry_delay  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.default_domain_id    = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.default_domain_name  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.domain_id            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.domain_name          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.endpoint_override    = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.insecure             = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.keyfile              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.max_version          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.min_version          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.password             = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.project_domain_id    = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.project_domain_name  = Default {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.project_id           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.project_name         = service {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.region_name          = RegionOne {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.service_name         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.service_type         = placement {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.split_loggers        = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.status_code_retries  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.status_code_retry_delay = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.system_scope         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.timeout              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.trust_id             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.user_domain_id       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.user_domain_name     = Default {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.user_id              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.username             = placement {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] placement.version              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.cores                    = 20 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.count_usage_from_placement = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.injected_file_content_bytes = 10240 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.injected_file_path_length = 255 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.injected_files           = 5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.instances                = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.key_pairs                = 100 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.metadata_items           = 128 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.ram                      = 51200 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.recheck_quota            = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.server_group_members     = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] quota.server_groups            = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] rdp.enabled                    = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.image_metadata_prefilter = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.max_attempts         = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.max_placement_results = 1000 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] scheduler.workers              = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.host_subset_size = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.isolated_hosts = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.isolated_images = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.pci_in_placement = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.track_instance_changes = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] metrics.required               = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] metrics.weight_multiplier      = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] metrics.weight_setting         = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] serial_console.enabled         = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] serial_console.port_range      = 10000:20000 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] serial_console.serialproxy_port = 6083 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.auth_section      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.auth_type         = password {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.cafile            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.certfile          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.collect_timing    = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.insecure          = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.keyfile           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.send_service_user_token = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.split_loggers     = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] service_user.timeout           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.agent_enabled            = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.enabled                  = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.html5proxy_port          = 6082 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.image_compression        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.jpeg_compression         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.playback_compression     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.server_listen            = 127.0.0.1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.streaming_mode           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] spice.zlib_compression         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] upgrade_levels.baseapi         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] upgrade_levels.cert            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] upgrade_levels.compute         = auto {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] upgrade_levels.conductor       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] upgrade_levels.scheduler       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vendordata_dynamic_auth.cafile = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vendordata_dynamic_auth.certfile = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vendordata_dynamic_auth.insecure = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vendordata_dynamic_auth.timeout = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.api_retry_count         = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.ca_file                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.cache_prefix            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.cluster_name            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.connection_pool_size    = 10 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.console_delay_seconds   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.datastore_regex         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.host_ip                 = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.host_password           = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.host_port               = 443 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.host_username           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.insecure                = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.integration_bridge      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.maximum_objects         = 100 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.pbm_default_policy      = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.pbm_enabled             = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.pbm_wsdl_location       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.serial_port_proxy_uri   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.serial_port_service_uri = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.task_poll_interval      = 0.5 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.use_linked_clone        = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.vnc_keymap              = en-us {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.vnc_port                = 5900 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vmware.vnc_port_total          = 10000 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.auth_schemes               = ['none'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.enabled                    = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.novncproxy_port            = 6080 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.vencrypt_ca_certs          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.vencrypt_client_cert       = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vnc.vencrypt_client_key        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.disable_rootwrap   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.enable_numa_live_migration = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.libvirt_disable_apic = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.client_socket_timeout     = 900 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.default_pool_size         = 1000 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.keep_alive                = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.max_header_line           = 16384 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.ssl_ca_file               = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.ssl_cert_file             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.ssl_key_file              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.tcp_keepidle              = 600 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] zvm.ca_file                    = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] zvm.cloud_connector_url        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] zvm.reachable_timeout          = 300 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.enforce_new_defaults = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.enforce_scope      = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.policy_default_rule = default {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.connection_string     = messaging:// {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.enabled               = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.es_doc_type           = notification {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.es_scroll_size        = 10000 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.es_scroll_time        = 2m {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.filter_error_trace    = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.hmac_keys             = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.sentinel_service_name = mymaster {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.socket_timeout        = 0.1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.trace_requests        = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler.trace_sqlalchemy      = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler_jaeger.process_tags   = {} {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler_jaeger.service_name_prefix = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] profiler_otlp.service_name_prefix = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] remote_debug.host              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] remote_debug.port              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_notifications.retry = -1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.auth_section        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.auth_type           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.cafile              = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.certfile            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.collect_timing      = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.connect_retries     = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.connect_retry_delay = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.endpoint_id         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.endpoint_override   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.insecure            = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.keyfile             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.max_version         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.min_version         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.region_name         = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.service_name        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.service_type        = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.split_loggers       = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.status_code_retries = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.status_code_retry_delay = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.timeout             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.valid_interfaces    = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_limit.version             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_reports.file_event_handler = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] oslo_reports.log_dir           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_ovs_privileged.group  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] vif_plug_ovs_privileged.user   = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_ovs.isolate_vif         = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] os_brick.lock_path             = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] privsep_osbrick.capabilities   = [21] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] privsep_osbrick.group          = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] privsep_osbrick.helper_command = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] privsep_osbrick.user           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] nova_sys_admin.group           = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] nova_sys_admin.helper_command  = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] nova_sys_admin.user            = None {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG oslo_service.service [None req-9aefc07e-c890-4d62-99fe-2538eca1b523 None None] ******************************************************************************** {{(pid=73476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 20:37:20 user nova-compute[73476]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 20:37:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Starting native event thread {{(pid=73476) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Starting green dispatch thread {{(pid=73476) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Starting connection event dispatch thread {{(pid=73476) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Connecting to libvirt: qemu:///system {{(pid=73476) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f25d49867d0> {{(pid=73476) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 20:37:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f25d49867d0> {{(pid=73476) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 20:37:20 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Connection event '1' reason 'None'
Aug 26 20:37:20 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 20:37:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.mount [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Initialising _HostMountState generation 0 {{(pid=73476) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 20:37:27 user nova-compute[73476]: INFO nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt host capabilities <capabilities>
Aug 26 20:37:27 user nova-compute[73476]:   <host>
Aug 26 20:37:27 user nova-compute[73476]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 20:37:27 user nova-compute[73476]:     <cpu>
Aug 26 20:37:27 user nova-compute[73476]:       <arch>x86_64</arch>
Aug 26 20:37:27 user nova-compute[73476]:       <model>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <vendor>Intel</vendor>
Aug 26 20:37:27 user nova-compute[73476]:       <microcode version='1070'/>
Aug 26 20:37:27 user nova-compute[73476]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 20:37:27 user nova-compute[73476]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='ss'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='vmx'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='pcid'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='osxsave'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='hypervisor'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='arat'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='tsc_adjust'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='md-clear'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='arch-capabilities'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='invtsc'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='rsba'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 20:37:27 user nova-compute[73476]:       <pages unit='KiB' size='4'/>
Aug 26 20:37:27 user nova-compute[73476]:       <pages unit='KiB' size='2048'/>
Aug 26 20:37:27 user nova-compute[73476]:     </cpu>
Aug 26 20:37:27 user nova-compute[73476]:     <power_management>
Aug 26 20:37:27 user nova-compute[73476]:       <suspend_mem/>
Aug 26 20:37:27 user nova-compute[73476]:       <suspend_disk/>
Aug 26 20:37:27 user nova-compute[73476]:       <suspend_hybrid/>
Aug 26 20:37:27 user nova-compute[73476]:     </power_management>
Aug 26 20:37:27 user nova-compute[73476]:     <iommu support='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     <migration_features>
Aug 26 20:37:27 user nova-compute[73476]:       <live/>
Aug 26 20:37:27 user nova-compute[73476]:       <uri_transports>
Aug 26 20:37:27 user nova-compute[73476]:         <uri_transport>tcp</uri_transport>
Aug 26 20:37:27 user nova-compute[73476]:         <uri_transport>rdma</uri_transport>
Aug 26 20:37:27 user nova-compute[73476]:       </uri_transports>
Aug 26 20:37:27 user nova-compute[73476]:     </migration_features>
Aug 26 20:37:27 user nova-compute[73476]:     <topology>
Aug 26 20:37:27 user nova-compute[73476]:       <cells num='2'>
Aug 26 20:37:27 user nova-compute[73476]:         <cell id='0'>
Aug 26 20:37:27 user nova-compute[73476]:           <memory unit='KiB'>8140616</memory>
Aug 26 20:37:27 user nova-compute[73476]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 26 20:37:27 user nova-compute[73476]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 20:37:27 user nova-compute[73476]:           <distances>
Aug 26 20:37:27 user nova-compute[73476]:             <sibling id='0' value='10'/>
Aug 26 20:37:27 user nova-compute[73476]:             <sibling id='1' value='20'/>
Aug 26 20:37:27 user nova-compute[73476]:           </distances>
Aug 26 20:37:27 user nova-compute[73476]:           <cpus num='6'>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 20:37:27 user nova-compute[73476]:           </cpus>
Aug 26 20:37:27 user nova-compute[73476]:         </cell>
Aug 26 20:37:27 user nova-compute[73476]:         <cell id='1'>
Aug 26 20:37:27 user nova-compute[73476]:           <memory unit='KiB'>8255100</memory>
Aug 26 20:37:27 user nova-compute[73476]:           <pages unit='KiB' size='4'>2063775</pages>
Aug 26 20:37:27 user nova-compute[73476]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 20:37:27 user nova-compute[73476]:           <distances>
Aug 26 20:37:27 user nova-compute[73476]:             <sibling id='0' value='20'/>
Aug 26 20:37:27 user nova-compute[73476]:             <sibling id='1' value='10'/>
Aug 26 20:37:27 user nova-compute[73476]:           </distances>
Aug 26 20:37:27 user nova-compute[73476]:           <cpus num='6'>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 20:37:27 user nova-compute[73476]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 20:37:27 user nova-compute[73476]:           </cpus>
Aug 26 20:37:27 user nova-compute[73476]:         </cell>
Aug 26 20:37:27 user nova-compute[73476]:       </cells>
Aug 26 20:37:27 user nova-compute[73476]:     </topology>
Aug 26 20:37:27 user nova-compute[73476]:     <cache>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 20:37:27 user nova-compute[73476]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 20:37:27 user nova-compute[73476]:     </cache>
Aug 26 20:37:27 user nova-compute[73476]:     <secmodel>
Aug 26 20:37:27 user nova-compute[73476]:       <model>apparmor</model>
Aug 26 20:37:27 user nova-compute[73476]:       <doi>0</doi>
Aug 26 20:37:27 user nova-compute[73476]:     </secmodel>
Aug 26 20:37:27 user nova-compute[73476]:     <secmodel>
Aug 26 20:37:27 user nova-compute[73476]:       <model>dac</model>
Aug 26 20:37:27 user nova-compute[73476]:       <doi>0</doi>
Aug 26 20:37:27 user nova-compute[73476]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 20:37:27 user nova-compute[73476]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 20:37:27 user nova-compute[73476]:     </secmodel>
Aug 26 20:37:27 user nova-compute[73476]:   </host>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='alpha'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>clipper</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='armv6l'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>spitz</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>nuri</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>kzm</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sx1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>z2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>tosa</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>n810</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>n800</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>terrier</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>midway</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>microbit</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>verdex</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>highbank</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>akita</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>connex</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>collie</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='armv7l'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>spitz</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>nuri</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>kzm</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sx1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>z2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>tosa</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>n810</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>n800</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>terrier</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>midway</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>microbit</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>verdex</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>highbank</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>akita</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>connex</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>collie</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='aarch64'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>spitz</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>nuri</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>kzm</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sx1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>z2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>tosa</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>n810</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>n800</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>terrier</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>midway</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>microbit</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>verdex</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>highbank</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>akita</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>connex</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>collie</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <acpi default='on' toggle='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='cris'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='i686'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>isapc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>microvm</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='kvm'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <pae/>
Aug 26 20:37:27 user nova-compute[73476]:       <nonpae/>
Aug 26 20:37:27 user nova-compute[73476]:       <acpi default='on' toggle='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:       <apic default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='m68k'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>an5206</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>q800</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='microblaze'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='microblazeel'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='mips'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='16'>malta</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='mipsel'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='16'>malta</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='mips64'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='16'>malta</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>pica61</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>magnum</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='mips64el'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='16'>malta</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>pica61</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>magnum</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='16'>boston</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='ppc'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mac99</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>40p</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>taihu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='ppc64'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>taihu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>40p</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mac99</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='ppc64le'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>taihu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>40p</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>mac99</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='riscv32'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='8'>spike</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='8'>virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='riscv64'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='8'>spike</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='8'>virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='s390x'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='sh4'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>shix</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>r2d</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='sh4eb'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>shix</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>r2d</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='sparc'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>LX</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='sparc64'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>niagara</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='x86_64'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>64</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='1'>isapc</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>microvm</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='kvm'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <acpi default='on' toggle='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:       <apic default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='xtensa'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>sim</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>kc705</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>ml605</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>lx200</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>lx60</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]:   <guest>
Aug 26 20:37:27 user nova-compute[73476]:     <os_type>hvm</os_type>
Aug 26 20:37:27 user nova-compute[73476]:     <arch name='xtensaeb'>
Aug 26 20:37:27 user nova-compute[73476]:       <wordsize>32</wordsize>
Aug 26 20:37:27 user nova-compute[73476]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='4'>sim</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>kc705</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>ml605</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>virt</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>lx200</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>lx60</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 20:37:27 user nova-compute[73476]:       <domain type='qemu'/>
Aug 26 20:37:27 user nova-compute[73476]:     </arch>
Aug 26 20:37:27 user nova-compute[73476]:     <features>
Aug 26 20:37:27 user nova-compute[73476]:       <cpuselection/>
Aug 26 20:37:27 user nova-compute[73476]:       <deviceboot/>
Aug 26 20:37:27 user nova-compute[73476]:       <disksnapshot default='on' toggle='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     </features>
Aug 26 20:37:27 user nova-compute[73476]:   </guest>
Aug 26 20:37:27 user nova-compute[73476]: </capabilities>
Aug 26 20:37:27 user nova-compute[73476]: 
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 20:37:27 user nova-compute[73476]: <domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 20:37:27 user nova-compute[73476]:   <domain>kvm</domain>
Aug 26 20:37:27 user nova-compute[73476]:   <machine>pc-q35-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:   <arch>i686</arch>
Aug 26 20:37:27 user nova-compute[73476]:   <vcpu max='288'/>
Aug 26 20:37:27 user nova-compute[73476]:   <iothreads supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:   <os supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='firmware'/>
Aug 26 20:37:27 user nova-compute[73476]:     <loader supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>rom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pflash</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='readonly'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='secure'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </loader>
Aug 26 20:37:27 user nova-compute[73476]:   </os>
Aug 26 20:37:27 user nova-compute[73476]:   <cpu>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-passthrough' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='hostPassthroughMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='maximum' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='maximumMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-model' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <vendor>Intel</vendor>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ss'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='vmx'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pcid'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='hypervisor'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arat'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='umip'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='md-clear'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibpb'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibrs'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='erms'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='lm'/>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='custom' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>qemu64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>qemu32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>phenom</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>n270</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>kvm64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>coreduo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>core2duo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>athlon</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Westmere</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Snowridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Penryn</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G5</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G4</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G1</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Nehalem</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Rome</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Milan</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Dhyana</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cooperlake</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Conroe</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>486</model>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:   </cpu>
Aug 26 20:37:27 user nova-compute[73476]:   <memoryBacking supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='sourceType'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>file</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>anonymous</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>memfd</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:   </memoryBacking>
Aug 26 20:37:27 user nova-compute[73476]:   <devices>
Aug 26 20:37:27 user nova-compute[73476]:     <disk supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='diskDevice'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>disk</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cdrom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>floppy</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>lun</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='bus'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>fdc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sata</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </disk>
Aug 26 20:37:27 user nova-compute[73476]:     <graphics supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sdl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vnc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>spice</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egl-headless</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </graphics>
Aug 26 20:37:27 user nova-compute[73476]:     <video supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='modelType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cirrus</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vmvga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>qxl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>none</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>bochs</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ramfb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </video>
Aug 26 20:37:27 user nova-compute[73476]:     <hostdev supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='mode'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>subsystem</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='startupPolicy'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>default</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>mandatory</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>requisite</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>optional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='subsysType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pci</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='capsType'/>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='pciBackend'/>
Aug 26 20:37:27 user nova-compute[73476]:     </hostdev>
Aug 26 20:37:27 user nova-compute[73476]:     <rng supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>random</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egd</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>builtin</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </rng>
Aug 26 20:37:27 user nova-compute[73476]:     <filesystem supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='driverType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>path</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>handle</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtiofs</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </filesystem>
Aug 26 20:37:27 user nova-compute[73476]:     <tpm supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-tis</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-crb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>passthrough</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>emulator</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </tpm>
Aug 26 20:37:27 user nova-compute[73476]:   </devices>
Aug 26 20:37:27 user nova-compute[73476]:   <features>
Aug 26 20:37:27 user nova-compute[73476]:     <gic supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     <vmcoreinfo supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <genid supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backingStoreInput supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backup supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <sev supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:   </features>
Aug 26 20:37:27 user nova-compute[73476]: </domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:  {{(pid=73476) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 20:37:27 user nova-compute[73476]: <domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 20:37:27 user nova-compute[73476]:   <domain>kvm</domain>
Aug 26 20:37:27 user nova-compute[73476]:   <machine>pc-q35-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:   <arch>i686</arch>
Aug 26 20:37:27 user nova-compute[73476]:   <vcpu max='288'/>
Aug 26 20:37:27 user nova-compute[73476]:   <iothreads supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:   <os supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='firmware'/>
Aug 26 20:37:27 user nova-compute[73476]:     <loader supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>rom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pflash</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='readonly'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='secure'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </loader>
Aug 26 20:37:27 user nova-compute[73476]:   </os>
Aug 26 20:37:27 user nova-compute[73476]:   <cpu>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-passthrough' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='hostPassthroughMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='maximum' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='maximumMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-model' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <vendor>Intel</vendor>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ss'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='vmx'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pcid'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='hypervisor'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arat'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='umip'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='md-clear'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibpb'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibrs'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='erms'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='lm'/>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='custom' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>qemu64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>qemu32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>phenom</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>n270</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>kvm64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>coreduo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>core2duo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>athlon</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Westmere</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Snowridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Penryn</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G5</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G4</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G1</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Nehalem</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Rome</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Milan</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Dhyana</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cooperlake</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Conroe</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>486</model>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:   </cpu>
Aug 26 20:37:27 user nova-compute[73476]:   <memoryBacking supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='sourceType'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>file</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>anonymous</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>memfd</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:   </memoryBacking>
Aug 26 20:37:27 user nova-compute[73476]:   <devices>
Aug 26 20:37:27 user nova-compute[73476]:     <disk supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='diskDevice'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>disk</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cdrom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>floppy</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>lun</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='bus'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>fdc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sata</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </disk>
Aug 26 20:37:27 user nova-compute[73476]:     <graphics supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sdl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vnc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>spice</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egl-headless</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </graphics>
Aug 26 20:37:27 user nova-compute[73476]:     <video supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='modelType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cirrus</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vmvga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>qxl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>none</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>bochs</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ramfb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </video>
Aug 26 20:37:27 user nova-compute[73476]:     <hostdev supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='mode'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>subsystem</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='startupPolicy'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>default</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>mandatory</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>requisite</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>optional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='subsysType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pci</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='capsType'/>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='pciBackend'/>
Aug 26 20:37:27 user nova-compute[73476]:     </hostdev>
Aug 26 20:37:27 user nova-compute[73476]:     <rng supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>random</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egd</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>builtin</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </rng>
Aug 26 20:37:27 user nova-compute[73476]:     <filesystem supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='driverType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>path</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>handle</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtiofs</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </filesystem>
Aug 26 20:37:27 user nova-compute[73476]:     <tpm supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-tis</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-crb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>passthrough</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>emulator</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </tpm>
Aug 26 20:37:27 user nova-compute[73476]:   </devices>
Aug 26 20:37:27 user nova-compute[73476]:   <features>
Aug 26 20:37:27 user nova-compute[73476]:     <gic supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     <vmcoreinfo supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <genid supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backingStoreInput supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backup supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <sev supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:   </features>
Aug 26 20:37:27 user nova-compute[73476]: </domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:  {{(pid=73476) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 20:37:27 user nova-compute[73476]: <domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 20:37:27 user nova-compute[73476]:   <domain>kvm</domain>
Aug 26 20:37:27 user nova-compute[73476]:   <machine>pc-i440fx-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:   <arch>i686</arch>
Aug 26 20:37:27 user nova-compute[73476]:   <vcpu max='255'/>
Aug 26 20:37:27 user nova-compute[73476]:   <iothreads supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:   <os supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='firmware'/>
Aug 26 20:37:27 user nova-compute[73476]:     <loader supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>rom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pflash</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='readonly'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='secure'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </loader>
Aug 26 20:37:27 user nova-compute[73476]:   </os>
Aug 26 20:37:27 user nova-compute[73476]:   <cpu>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-passthrough' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='hostPassthroughMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='maximum' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='maximumMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-model' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <vendor>Intel</vendor>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ss'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='vmx'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pcid'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='hypervisor'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arat'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='umip'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='md-clear'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibpb'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibrs'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='erms'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='lm'/>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='custom' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>qemu64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>qemu32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>phenom</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>n270</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>kvm64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>coreduo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>core2duo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>athlon</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Westmere</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Snowridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Penryn</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G5</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G4</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G1</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Nehalem</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Rome</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Milan</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Dhyana</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cooperlake</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Conroe</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>486</model>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:   </cpu>
Aug 26 20:37:27 user nova-compute[73476]:   <memoryBacking supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='sourceType'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>file</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>anonymous</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>memfd</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:   </memoryBacking>
Aug 26 20:37:27 user nova-compute[73476]:   <devices>
Aug 26 20:37:27 user nova-compute[73476]:     <disk supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='diskDevice'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>disk</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cdrom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>floppy</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>lun</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='bus'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ide</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>fdc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sata</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </disk>
Aug 26 20:37:27 user nova-compute[73476]:     <graphics supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sdl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vnc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>spice</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egl-headless</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </graphics>
Aug 26 20:37:27 user nova-compute[73476]:     <video supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='modelType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cirrus</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vmvga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>qxl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>none</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>bochs</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ramfb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </video>
Aug 26 20:37:27 user nova-compute[73476]:     <hostdev supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='mode'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>subsystem</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='startupPolicy'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>default</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>mandatory</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>requisite</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>optional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='subsysType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pci</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='capsType'/>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='pciBackend'/>
Aug 26 20:37:27 user nova-compute[73476]:     </hostdev>
Aug 26 20:37:27 user nova-compute[73476]:     <rng supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>random</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egd</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>builtin</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </rng>
Aug 26 20:37:27 user nova-compute[73476]:     <filesystem supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='driverType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>path</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>handle</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtiofs</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </filesystem>
Aug 26 20:37:27 user nova-compute[73476]:     <tpm supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-tis</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-crb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>passthrough</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>emulator</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </tpm>
Aug 26 20:37:27 user nova-compute[73476]:   </devices>
Aug 26 20:37:27 user nova-compute[73476]:   <features>
Aug 26 20:37:27 user nova-compute[73476]:     <gic supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     <vmcoreinfo supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <genid supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backingStoreInput supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backup supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <sev supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:   </features>
Aug 26 20:37:27 user nova-compute[73476]: </domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:  {{(pid=73476) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 20:37:27 user nova-compute[73476]: <domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 20:37:27 user nova-compute[73476]:   <domain>kvm</domain>
Aug 26 20:37:27 user nova-compute[73476]:   <machine>pc-i440fx-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:   <arch>i686</arch>
Aug 26 20:37:27 user nova-compute[73476]:   <vcpu max='255'/>
Aug 26 20:37:27 user nova-compute[73476]:   <iothreads supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:   <os supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='firmware'/>
Aug 26 20:37:27 user nova-compute[73476]:     <loader supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>rom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pflash</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='readonly'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='secure'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </loader>
Aug 26 20:37:27 user nova-compute[73476]:   </os>
Aug 26 20:37:27 user nova-compute[73476]:   <cpu>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-passthrough' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='hostPassthroughMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='maximum' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='maximumMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-model' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <vendor>Intel</vendor>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ss'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='vmx'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pcid'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='hypervisor'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arat'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='umip'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='md-clear'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibpb'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibrs'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='erms'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='lm'/>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='custom' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>qemu64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>qemu32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>phenom</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>n270</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>kvm64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>coreduo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>core2duo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>athlon</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Westmere</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Snowridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Penryn</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G5</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G4</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G1</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Nehalem</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Rome</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Milan</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Dhyana</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cooperlake</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Conroe</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>486</model>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:   </cpu>
Aug 26 20:37:27 user nova-compute[73476]:   <memoryBacking supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='sourceType'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>file</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>anonymous</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>memfd</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:   </memoryBacking>
Aug 26 20:37:27 user nova-compute[73476]:   <devices>
Aug 26 20:37:27 user nova-compute[73476]:     <disk supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='diskDevice'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>disk</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cdrom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>floppy</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>lun</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='bus'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ide</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>fdc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sata</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </disk>
Aug 26 20:37:27 user nova-compute[73476]:     <graphics supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sdl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vnc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>spice</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egl-headless</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </graphics>
Aug 26 20:37:27 user nova-compute[73476]:     <video supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='modelType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cirrus</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vmvga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>qxl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>none</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>bochs</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ramfb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </video>
Aug 26 20:37:27 user nova-compute[73476]:     <hostdev supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='mode'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>subsystem</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='startupPolicy'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>default</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>mandatory</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>requisite</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>optional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='subsysType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pci</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='capsType'/>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='pciBackend'/>
Aug 26 20:37:27 user nova-compute[73476]:     </hostdev>
Aug 26 20:37:27 user nova-compute[73476]:     <rng supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>random</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egd</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>builtin</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </rng>
Aug 26 20:37:27 user nova-compute[73476]:     <filesystem supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='driverType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>path</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>handle</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtiofs</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </filesystem>
Aug 26 20:37:27 user nova-compute[73476]:     <tpm supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-tis</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-crb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>passthrough</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>emulator</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </tpm>
Aug 26 20:37:27 user nova-compute[73476]:   </devices>
Aug 26 20:37:27 user nova-compute[73476]:   <features>
Aug 26 20:37:27 user nova-compute[73476]:     <gic supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     <vmcoreinfo supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <genid supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backingStoreInput supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backup supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <sev supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:   </features>
Aug 26 20:37:27 user nova-compute[73476]: </domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:  {{(pid=73476) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 20:37:27 user nova-compute[73476]: <domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 20:37:27 user nova-compute[73476]:   <domain>kvm</domain>
Aug 26 20:37:27 user nova-compute[73476]:   <machine>pc-q35-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:   <arch>x86_64</arch>
Aug 26 20:37:27 user nova-compute[73476]:   <vcpu max='288'/>
Aug 26 20:37:27 user nova-compute[73476]:   <iothreads supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:   <os supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='firmware'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>efi</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:     <loader supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>rom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pflash</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='readonly'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='secure'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </loader>
Aug 26 20:37:27 user nova-compute[73476]:   </os>
Aug 26 20:37:27 user nova-compute[73476]:   <cpu>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-passthrough' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='hostPassthroughMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='maximum' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='maximumMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-model' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <vendor>Intel</vendor>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ss'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='vmx'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pcid'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='hypervisor'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arat'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='umip'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='md-clear'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='invtsc'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibpb'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibrs'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='rsba'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='erms'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='custom' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>qemu64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>qemu32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>phenom</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>n270</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>coreduo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>core2duo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>athlon</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Westmere</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Snowridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Penryn</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G5</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G4</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Opteron_G1</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Nehalem</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Rome</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Milan</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Dhyana</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cooperlake</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Conroe</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>486</model>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:   </cpu>
Aug 26 20:37:27 user nova-compute[73476]:   <memoryBacking supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='sourceType'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>file</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>anonymous</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>memfd</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:   </memoryBacking>
Aug 26 20:37:27 user nova-compute[73476]:   <devices>
Aug 26 20:37:27 user nova-compute[73476]:     <disk supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='diskDevice'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>disk</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cdrom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>floppy</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>lun</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='bus'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>fdc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sata</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </disk>
Aug 26 20:37:27 user nova-compute[73476]:     <graphics supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sdl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vnc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>spice</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egl-headless</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </graphics>
Aug 26 20:37:27 user nova-compute[73476]:     <video supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='modelType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cirrus</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vmvga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>qxl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>none</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>bochs</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ramfb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </video>
Aug 26 20:37:27 user nova-compute[73476]:     <hostdev supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='mode'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>subsystem</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='startupPolicy'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>default</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>mandatory</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>requisite</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>optional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='subsysType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pci</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='capsType'/>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='pciBackend'/>
Aug 26 20:37:27 user nova-compute[73476]:     </hostdev>
Aug 26 20:37:27 user nova-compute[73476]:     <rng supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>random</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egd</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>builtin</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </rng>
Aug 26 20:37:27 user nova-compute[73476]:     <filesystem supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='driverType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>path</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>handle</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtiofs</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </filesystem>
Aug 26 20:37:27 user nova-compute[73476]:     <tpm supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-tis</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-crb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>passthrough</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>emulator</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </tpm>
Aug 26 20:37:27 user nova-compute[73476]:   </devices>
Aug 26 20:37:27 user nova-compute[73476]:   <features>
Aug 26 20:37:27 user nova-compute[73476]:     <gic supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     <vmcoreinfo supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <genid supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backingStoreInput supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backup supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <sev supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:   </features>
Aug 26 20:37:27 user nova-compute[73476]: </domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:  {{(pid=73476) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 20:37:27 user nova-compute[73476]: <domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 20:37:27 user nova-compute[73476]:   <domain>kvm</domain>
Aug 26 20:37:27 user nova-compute[73476]:   <machine>pc-q35-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:   <arch>x86_64</arch>
Aug 26 20:37:27 user nova-compute[73476]:   <vcpu max='288'/>
Aug 26 20:37:27 user nova-compute[73476]:   <iothreads supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:   <os supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='firmware'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>efi</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:     <loader supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>rom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pflash</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='readonly'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='secure'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </loader>
Aug 26 20:37:27 user nova-compute[73476]:   </os>
Aug 26 20:37:27 user nova-compute[73476]:   <cpu>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-passthrough' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='hostPassthroughMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='maximum' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='maximumMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-model' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <vendor>Intel</vendor>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ss'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='vmx'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pcid'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='hypervisor'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arat'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='umip'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='md-clear'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='invtsc'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibpb'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibrs'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='rsba'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='erms'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='custom' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>qemu64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>qemu32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>phenom</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>n270</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>coreduo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>core2duo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>athlon</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Westmere</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Snowridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Penryn</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G5</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G4</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Opteron_G1</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Nehalem</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Rome</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Milan</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Dhyana</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cooperlake</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Conroe</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>486</model>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:   </cpu>
Aug 26 20:37:27 user nova-compute[73476]:   <memoryBacking supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='sourceType'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>file</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>anonymous</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>memfd</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:   </memoryBacking>
Aug 26 20:37:27 user nova-compute[73476]:   <devices>
Aug 26 20:37:27 user nova-compute[73476]:     <disk supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='diskDevice'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>disk</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cdrom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>floppy</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>lun</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='bus'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>fdc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sata</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </disk>
Aug 26 20:37:27 user nova-compute[73476]:     <graphics supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sdl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vnc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>spice</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egl-headless</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </graphics>
Aug 26 20:37:27 user nova-compute[73476]:     <video supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='modelType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cirrus</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vmvga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>qxl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>none</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>bochs</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ramfb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </video>
Aug 26 20:37:27 user nova-compute[73476]:     <hostdev supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='mode'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>subsystem</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='startupPolicy'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>default</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>mandatory</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>requisite</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>optional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='subsysType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pci</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='capsType'/>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='pciBackend'/>
Aug 26 20:37:27 user nova-compute[73476]:     </hostdev>
Aug 26 20:37:27 user nova-compute[73476]:     <rng supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>random</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egd</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>builtin</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </rng>
Aug 26 20:37:27 user nova-compute[73476]:     <filesystem supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='driverType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>path</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>handle</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtiofs</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </filesystem>
Aug 26 20:37:27 user nova-compute[73476]:     <tpm supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-tis</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-crb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>passthrough</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>emulator</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </tpm>
Aug 26 20:37:27 user nova-compute[73476]:   </devices>
Aug 26 20:37:27 user nova-compute[73476]:   <features>
Aug 26 20:37:27 user nova-compute[73476]:     <gic supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     <vmcoreinfo supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <genid supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backingStoreInput supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backup supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <sev supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:   </features>
Aug 26 20:37:27 user nova-compute[73476]: </domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:  {{(pid=73476) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 20:37:27 user nova-compute[73476]: <domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 20:37:27 user nova-compute[73476]:   <domain>kvm</domain>
Aug 26 20:37:27 user nova-compute[73476]:   <machine>pc-i440fx-jammy</machine>
Aug 26 20:37:27 user nova-compute[73476]:   <arch>x86_64</arch>
Aug 26 20:37:27 user nova-compute[73476]:   <vcpu max='255'/>
Aug 26 20:37:27 user nova-compute[73476]:   <iothreads supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:   <os supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='firmware'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>efi</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:     <loader supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>rom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pflash</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='readonly'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='secure'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </loader>
Aug 26 20:37:27 user nova-compute[73476]:   </os>
Aug 26 20:37:27 user nova-compute[73476]:   <cpu>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-passthrough' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='hostPassthroughMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='maximum' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='maximumMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-model' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <vendor>Intel</vendor>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ss'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='vmx'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pcid'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='hypervisor'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arat'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='umip'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='md-clear'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='invtsc'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibpb'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibrs'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='rsba'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='erms'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='custom' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>qemu64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>qemu32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>phenom</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>n270</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>coreduo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>core2duo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>athlon</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Westmere</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Snowridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Penryn</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G5</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G4</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Opteron_G1</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Nehalem</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Rome</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Milan</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Dhyana</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cooperlake</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Conroe</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>486</model>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:   </cpu>
Aug 26 20:37:27 user nova-compute[73476]:   <memoryBacking supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='sourceType'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>file</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>anonymous</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>memfd</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:   </memoryBacking>
Aug 26 20:37:27 user nova-compute[73476]:   <devices>
Aug 26 20:37:27 user nova-compute[73476]:     <disk supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='diskDevice'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>disk</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cdrom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>floppy</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>lun</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='bus'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ide</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>fdc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sata</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </disk>
Aug 26 20:37:27 user nova-compute[73476]:     <graphics supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sdl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vnc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>spice</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egl-headless</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </graphics>
Aug 26 20:37:27 user nova-compute[73476]:     <video supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='modelType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cirrus</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vmvga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>qxl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>none</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>bochs</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ramfb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </video>
Aug 26 20:37:27 user nova-compute[73476]:     <hostdev supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='mode'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>subsystem</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='startupPolicy'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>default</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>mandatory</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>requisite</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>optional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='subsysType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pci</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='capsType'/>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='pciBackend'/>
Aug 26 20:37:27 user nova-compute[73476]:     </hostdev>
Aug 26 20:37:27 user nova-compute[73476]:     <rng supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>random</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egd</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>builtin</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </rng>
Aug 26 20:37:27 user nova-compute[73476]:     <filesystem supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='driverType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>path</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>handle</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtiofs</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </filesystem>
Aug 26 20:37:27 user nova-compute[73476]:     <tpm supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-tis</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-crb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>passthrough</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>emulator</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </tpm>
Aug 26 20:37:27 user nova-compute[73476]:   </devices>
Aug 26 20:37:27 user nova-compute[73476]:   <features>
Aug 26 20:37:27 user nova-compute[73476]:     <gic supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     <vmcoreinfo supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <genid supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backingStoreInput supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backup supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <sev supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:   </features>
Aug 26 20:37:27 user nova-compute[73476]: </domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:  {{(pid=73476) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 20:37:27 user nova-compute[73476]: <domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 20:37:27 user nova-compute[73476]:   <domain>kvm</domain>
Aug 26 20:37:27 user nova-compute[73476]:   <machine>pc-i440fx-6.2</machine>
Aug 26 20:37:27 user nova-compute[73476]:   <arch>x86_64</arch>
Aug 26 20:37:27 user nova-compute[73476]:   <vcpu max='255'/>
Aug 26 20:37:27 user nova-compute[73476]:   <iothreads supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:   <os supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='firmware'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>efi</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:     <loader supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>rom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pflash</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='readonly'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>yes</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='secure'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>no</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </loader>
Aug 26 20:37:27 user nova-compute[73476]:   </os>
Aug 26 20:37:27 user nova-compute[73476]:   <cpu>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-passthrough' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='hostPassthroughMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='maximum' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='maximumMigratable'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>on</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>off</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='host-model' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <vendor>Intel</vendor>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ss'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='vmx'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pcid'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='hypervisor'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arat'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='umip'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='md-clear'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='invtsc'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibpb'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='ibrs'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-stibp'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='rsba'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='erms'/>
Aug 26 20:37:27 user nova-compute[73476]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:     <mode name='custom' supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>qemu64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>qemu32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>phenom</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>pentium</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>n270</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm64</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>kvm32</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>coreduo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>core2duo</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>athlon</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Westmere</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Snowridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Skylake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>SandyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Penryn</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G5</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G4</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G3</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Opteron_G2</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Opteron_G1</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Nehalem</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>IvyBridge</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Icelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Haswell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Rome</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-Milan</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>EPYC</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Dhyana</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cooperlake</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>Conroe</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='no'>Broadwell</model>
Aug 26 20:37:27 user nova-compute[73476]:       <model usable='yes'>486</model>
Aug 26 20:37:27 user nova-compute[73476]:     </mode>
Aug 26 20:37:27 user nova-compute[73476]:   </cpu>
Aug 26 20:37:27 user nova-compute[73476]:   <memoryBacking supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:     <enum name='sourceType'>
Aug 26 20:37:27 user nova-compute[73476]:       <value>file</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>anonymous</value>
Aug 26 20:37:27 user nova-compute[73476]:       <value>memfd</value>
Aug 26 20:37:27 user nova-compute[73476]:     </enum>
Aug 26 20:37:27 user nova-compute[73476]:   </memoryBacking>
Aug 26 20:37:27 user nova-compute[73476]:   <devices>
Aug 26 20:37:27 user nova-compute[73476]:     <disk supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='diskDevice'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>disk</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cdrom</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>floppy</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>lun</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='bus'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ide</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>fdc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sata</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </disk>
Aug 26 20:37:27 user nova-compute[73476]:     <graphics supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='type'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>sdl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vnc</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>spice</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egl-headless</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </graphics>
Aug 26 20:37:27 user nova-compute[73476]:     <video supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='modelType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>cirrus</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>vmvga</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>qxl</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>none</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>bochs</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>ramfb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </video>
Aug 26 20:37:27 user nova-compute[73476]:     <hostdev supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='mode'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>subsystem</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='startupPolicy'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>default</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>mandatory</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>requisite</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>optional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='subsysType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>usb</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>pci</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>scsi</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='capsType'/>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='pciBackend'/>
Aug 26 20:37:27 user nova-compute[73476]:     </hostdev>
Aug 26 20:37:27 user nova-compute[73476]:     <rng supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtio-non-transitional</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>random</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>egd</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>builtin</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </rng>
Aug 26 20:37:27 user nova-compute[73476]:     <filesystem supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='driverType'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>path</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>handle</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>virtiofs</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </filesystem>
Aug 26 20:37:27 user nova-compute[73476]:     <tpm supported='yes'>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='model'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-tis</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>tpm-crb</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:       <enum name='backendModel'>
Aug 26 20:37:27 user nova-compute[73476]:         <value>passthrough</value>
Aug 26 20:37:27 user nova-compute[73476]:         <value>emulator</value>
Aug 26 20:37:27 user nova-compute[73476]:       </enum>
Aug 26 20:37:27 user nova-compute[73476]:     </tpm>
Aug 26 20:37:27 user nova-compute[73476]:   </devices>
Aug 26 20:37:27 user nova-compute[73476]:   <features>
Aug 26 20:37:27 user nova-compute[73476]:     <gic supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:     <vmcoreinfo supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <genid supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backingStoreInput supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <backup supported='yes'/>
Aug 26 20:37:27 user nova-compute[73476]:     <sev supported='no'/>
Aug 26 20:37:27 user nova-compute[73476]:   </features>
Aug 26 20:37:27 user nova-compute[73476]: </domainCapabilities>
Aug 26 20:37:27 user nova-compute[73476]:  {{(pid=73476) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73476) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73476) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Checking secure boot support for host arch (x86_64) {{(pid=73476) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 20:37:27 user nova-compute[73476]: INFO nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Secure Boot support detected
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] cpu compare xml: <cpu match="exact">
Aug 26 20:37:27 user nova-compute[73476]:   <model>Nehalem</model>
Aug 26 20:37:27 user nova-compute[73476]: </cpu>
Aug 26 20:37:27 user nova-compute[73476]:  {{(pid=73476) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 20:37:27 user nova-compute[73476]: INFO nova.virt.node [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Generated node identity b505444b-68ee-4bd2-bfa2-81c3d587cc2d
Aug 26 20:37:27 user nova-compute[73476]: INFO nova.virt.node [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Wrote node identity b505444b-68ee-4bd2-bfa2-81c3d587cc2d to /opt/stack/data/nova/compute_id
Aug 26 20:37:27 user nova-compute[73476]: WARNING nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Compute nodes ['b505444b-68ee-4bd2-bfa2-81c3d587cc2d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 20:37:27 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 20:37:27 user nova-compute[73476]: WARNING nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 20:37:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:37:27 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:37:27 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:37:27 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Hypervisor/Node resource view: name=user free_ram=10897MB free_disk=26.238067626953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:37:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:37:28 user nova-compute[73476]: WARNING nova.compute.resource_tracker [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] No compute node record for user:b505444b-68ee-4bd2-bfa2-81c3d587cc2d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b505444b-68ee-4bd2-bfa2-81c3d587cc2d could not be found.
Aug 26 20:37:28 user nova-compute[73476]: INFO nova.compute.resource_tracker [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Compute node record created for user:user with uuid: b505444b-68ee-4bd2-bfa2-81c3d587cc2d
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:37:28 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [req-6f47aeb2-e9bd-4e6e-bb7c-46870455a198] Created resource provider record via placement API for resource provider with UUID b505444b-68ee-4bd2-bfa2-81c3d587cc2d and name user.
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73476) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 20:37:28 user nova-compute[73476]: INFO nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] kernel doesn't support AMD SEV
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Libvirt baseline CPU <cpu>
Aug 26 20:37:28 user nova-compute[73476]:   <arch>x86_64</arch>
Aug 26 20:37:28 user nova-compute[73476]:   <model>Nehalem</model>
Aug 26 20:37:28 user nova-compute[73476]:   <vendor>Intel</vendor>
Aug 26 20:37:28 user nova-compute[73476]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 20:37:28 user nova-compute[73476]: </cpu>
Aug 26 20:37:28 user nova-compute[73476]:  {{(pid=73476) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Updated inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Updating resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d generation from 0 to 1 during operation: update_inventory {{(pid=73476) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Updating resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d generation from 1 to 2 during operation: update_traits {{(pid=73476) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.service [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Creating RPC server for service compute {{(pid=73476) start /opt/stack/nova/nova/service.py:182}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.service [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Join ServiceGroup membership for this service compute {{(pid=73476) start /opt/stack/nova/nova/service.py:199}}
Aug 26 20:37:28 user nova-compute[73476]: DEBUG nova.servicegroup.drivers.db [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73476) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 20:38:08 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:08 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:38:19 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:38:20 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:38:20 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:38:20 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=10288MB free_disk=26.141773223876953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:38:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:38:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:38:20 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:38:20 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:38:20 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:38:20 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:38:20 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:38:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:39:20 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:39:21 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:39:21 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:39:21 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=10223MB free_disk=26.187835693359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:39:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:39:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:39:21 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:39:21 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:39:21 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:39:21 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:39:21 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:39:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:39:22 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:39:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:39:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:39:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 20:39:22 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:40:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:40:21 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:40:21 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:40:21 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:40:21 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:40:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:40:22 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:40:22 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:40:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:40:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:40:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:40:22 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:40:23 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:40:23 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:40:23 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=10225MB free_disk=25.972091674804688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:40:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:40:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:40:23 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:40:23 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:40:23 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:40:23 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:40:23 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:40:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:40:24 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:40:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:40:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:40:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 20:40:24 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:20 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:21 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:21 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:21 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:41:23 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:23 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:24 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:24 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:24 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:41:25 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:25 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:25 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=9481MB free_disk=25.99462890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:41:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:25 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:41:25 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:41:25 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:41:25 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:41:25 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:41:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "22b50300-8865-4854-b0c7-ed63ca60c85b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:41:26 user nova-compute[73476]: INFO nova.compute.claims [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Claim successful on node user
Aug 26 20:41:26 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:41:26 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:41:27 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:41:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:41:27 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Creating image(s)
Aug 26 20:41:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "/opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "/opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "/opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:28 user nova-compute[73476]: DEBUG nova.policy [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ed2a98f37294fd381fd1dfe7c5c0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679727d63ba04ad48740d1b967be5a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:41:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b.part --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:28 user nova-compute[73476]: DEBUG nova.virt.images [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] 810a80fc-a1eb-411e-8c1f-b24c6f7ca436 was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 20:41:28 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:41:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b.part /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b.part /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b.converted" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.620s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:29 user nova-compute[73476]: INFO oslo.privsep.daemon [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppz72lkih/privsep.sock']
Aug 26 20:41:29 user sudo[82696]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppz72lkih/privsep.sock
Aug 26 20:41:29 user sudo[82696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 20:41:31 user sudo[82696]: pam_unix(sudo:session): session closed for user root
Aug 26 20:41:31 user nova-compute[73476]: INFO oslo.privsep.daemon [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Spawned new privsep daemon via rootwrap
Aug 26 20:41:31 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 20:41:31 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 20:41:31 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 20:41:31 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82699
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.153s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk 1073741824" returned: 0 in 0.049s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.155s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:41:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:32 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Cannot resize image /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:41:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:41:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Ensure instance console log exists: /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:41:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:32 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Successfully created port: 27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:41:33 user nova-compute[73476]: INFO nova.compute.claims [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Claim successful on node user
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.network.neutron [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:41:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:41:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Creating image(s)
Aug 26 20:41:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "/opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "/opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG nova.policy [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f012ed860c7c45f99300efaf9cc09145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedf64639896481fa1ab2f57fda22d85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.216s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk 1073741824" returned: 0 in 0.054s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.218s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Cannot resize image /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Ensure instance console log exists: /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:41:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "215be88c-8470-453f-b293-ce98148be308" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "215be88c-8470-453f-b293-ce98148be308" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:41:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:41:35 user nova-compute[73476]: INFO nova.compute.claims [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Claim successful on node user
Aug 26 20:41:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.374s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:41:36 user nova-compute[73476]: INFO nova.compute.claims [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Claim successful on node user
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:41:36 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:41:36 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Creating image(s)
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.policy [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb63707c9d734bf5b1d1bb20162e3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c713d9f0cc5f4dd7a8629ba1b27e72f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Successfully created port: db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Successfully updated port: 27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:41:36 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquired lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.229s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:41:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Creating image(s)
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "/opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "/opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "/opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk 1073741824" returned: 0 in 0.059s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:41:37 user nova-compute[73476]: INFO nova.compute.claims [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Claim successful on node user
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-b912f898-4763-4407-a1ff-967e4fa7e9f3 req-4d5ade63-79a8-44cd-af1b-f06a2f63e66f service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received event network-changed-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-b912f898-4763-4407-a1ff-967e4fa7e9f3 req-4d5ade63-79a8-44cd-af1b-f06a2f63e66f service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Refreshing instance network info cache due to event network-changed-27627bb2-3a27-4437-942f-3d72af60aad3. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b912f898-4763-4407-a1ff-967e4fa7e9f3 req-4d5ade63-79a8-44cd-af1b-f06a2f63e66f service nova] Acquiring lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.221s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.policy [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdf18fb0dcd64e11a7e42cc5184a219e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b16d8f644f0442fea1f8a57961111a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Cannot resize image /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Ensure instance console log exists: /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk 1073741824" returned: 0 in 0.044s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.436s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:41:37 user nova-compute[73476]: INFO nova.compute.claims [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Claim successful on node user
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:41:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.219s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Cannot resize image /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Ensure instance console log exists: /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:41:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Creating image(s)
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "/opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "/opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.policy [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18713e0a843f45f08cdb8d70e7cafeeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a9f74cd94849f7a132c168b1ed5622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:41:38 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.170s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk 1073741824" returned: 0 in 0.048s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:41:38 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Creating image(s)
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Cannot resize image /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Ensure instance console log exists: /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG nova.policy [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb63707c9d734bf5b1d1bb20162e3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c713d9f0cc5f4dd7a8629ba1b27e72f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk 1073741824" returned: 0 in 0.050s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Cannot resize image /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Ensure instance console log exists: /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updating instance_info_cache with network_info: [{"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Releasing lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Instance network_info: |[{"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b912f898-4763-4407-a1ff-967e4fa7e9f3 req-4d5ade63-79a8-44cd-af1b-f06a2f63e66f service nova] Acquired lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.network.neutron [req-b912f898-4763-4407-a1ff-967e4fa7e9f3 req-4d5ade63-79a8-44cd-af1b-f06a2f63e66f service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Refreshing network info cache for port 27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Start _get_guest_xml network_info=[{"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:41:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-443158251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-443158251',id=1,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-0ixuoad0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:27Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=22b50300-8865-4854-b0c7-ed63ca60c85b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:b8:59,bridge_name='br-int',has_traffic_filtering=True,id=27627bb2-3a27-4437-942f-3d72af60aad3,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27627bb2-3a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.objects.instance [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'pci_devices' on Instance uuid 22b50300-8865-4854-b0c7-ed63ca60c85b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:41:39 user nova-compute[73476]:   <uuid>22b50300-8865-4854-b0c7-ed63ca60c85b</uuid>
Aug 26 20:41:39 user nova-compute[73476]:   <name>instance-00000001</name>
Aug 26 20:41:39 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:41:39 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:41:39 user nova-compute[73476]:   <metadata>
Aug 26 20:41:39 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:41:39 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:41:39 user nova-compute[73476]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-443158251</nova:name>
Aug 26 20:41:39 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:41:39</nova:creationTime>
Aug 26 20:41:39 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:41:39 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:41:39 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:41:39 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:41:39 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:41:39 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:41:39 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:41:39 user nova-compute[73476]:       <nova:owner>
Aug 26 20:41:39 user nova-compute[73476]:         <nova:user uuid="5ed2a98f37294fd381fd1dfe7c5c0751">tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member</nova:user>
Aug 26 20:41:39 user nova-compute[73476]:         <nova:project uuid="679727d63ba04ad48740d1b967be5a61">tempest-ServerBootFromVolumeStableRescueTest-735166680</nova:project>
Aug 26 20:41:39 user nova-compute[73476]:       </nova:owner>
Aug 26 20:41:39 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:41:39 user nova-compute[73476]:       <nova:ports>
Aug 26 20:41:39 user nova-compute[73476]:         <nova:port uuid="27627bb2-3a27-4437-942f-3d72af60aad3">
Aug 26 20:41:39 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 20:41:39 user nova-compute[73476]:         </nova:port>
Aug 26 20:41:39 user nova-compute[73476]:       </nova:ports>
Aug 26 20:41:39 user nova-compute[73476]:     </nova:instance>
Aug 26 20:41:39 user nova-compute[73476]:   </metadata>
Aug 26 20:41:39 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:41:39 user nova-compute[73476]:     <system>
Aug 26 20:41:39 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:41:39 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:41:39 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:41:39 user nova-compute[73476]:       <entry name="serial">22b50300-8865-4854-b0c7-ed63ca60c85b</entry>
Aug 26 20:41:39 user nova-compute[73476]:       <entry name="uuid">22b50300-8865-4854-b0c7-ed63ca60c85b</entry>
Aug 26 20:41:39 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:41:39 user nova-compute[73476]:     </system>
Aug 26 20:41:39 user nova-compute[73476]:   </sysinfo>
Aug 26 20:41:39 user nova-compute[73476]:   <os>
Aug 26 20:41:39 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:41:39 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:41:39 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:41:39 user nova-compute[73476]:   </os>
Aug 26 20:41:39 user nova-compute[73476]:   <features>
Aug 26 20:41:39 user nova-compute[73476]:     <acpi/>
Aug 26 20:41:39 user nova-compute[73476]:     <apic/>
Aug 26 20:41:39 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:41:39 user nova-compute[73476]:   </features>
Aug 26 20:41:39 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:41:39 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:41:39 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:41:39 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:41:39 user nova-compute[73476]:   </clock>
Aug 26 20:41:39 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:41:39 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:41:39 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:41:39 user nova-compute[73476]:   </cpu>
Aug 26 20:41:39 user nova-compute[73476]:   <devices>
Aug 26 20:41:39 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:41:39 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:41:39 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk"/>
Aug 26 20:41:39 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:41:39 user nova-compute[73476]:     </disk>
Aug 26 20:41:39 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:41:39 user nova-compute[73476]:       <mac address="fa:16:3e:66:b8:59"/>
Aug 26 20:41:39 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:39 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:41:39 user nova-compute[73476]:       <target dev="tap27627bb2-3a"/>
Aug 26 20:41:39 user nova-compute[73476]:     </interface>
Aug 26 20:41:39 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:41:39 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/console.log" append="off"/>
Aug 26 20:41:39 user nova-compute[73476]:     </serial>
Aug 26 20:41:39 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:41:39 user nova-compute[73476]:     <video>
Aug 26 20:41:39 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:39 user nova-compute[73476]:     </video>
Aug 26 20:41:39 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:41:39 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:41:39 user nova-compute[73476]:     </rng>
Aug 26 20:41:39 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:41:39 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:41:39 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:41:39 user nova-compute[73476]:     </memballoon>
Aug 26 20:41:39 user nova-compute[73476]:   </devices>
Aug 26 20:41:39 user nova-compute[73476]: </domain>
Aug 26 20:41:39 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-443158251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-443158251',id=1,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-0ixuoad0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:27Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=22b50300-8865-4854-b0c7-ed63ca60c85b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:b8:59,bridge_name='br-int',has_traffic_filtering=True,id=27627bb2-3a27-4437-942f-3d72af60aad3,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27627bb2-3a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG os_vif [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:b8:59,bridge_name='br-int',has_traffic_filtering=True,id=27627bb2-3a27-4437-942f-3d72af60aad3,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27627bb2-3a') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Created schema index Interface.name {{(pid=73476) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Created schema index Port.name {{(pid=73476) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Created schema index Bridge.name {{(pid=73476) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [POLLOUT] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:41:39 user nova-compute[73476]: INFO oslo.privsep.daemon [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpblyu1p6d/privsep.sock']
Aug 26 20:41:39 user sudo[82812]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpblyu1p6d/privsep.sock
Aug 26 20:41:39 user sudo[82812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Successfully updated port: db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "refresh_cache-e2e5572a-5c09-4217-a5db-c05ebf3227e9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquired lock "refresh_cache-e2e5572a-5c09-4217-a5db-c05ebf3227e9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:41:40 user nova-compute[73476]: DEBUG nova.network.neutron [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:41:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-15bbc178-c601-4894-92be-cc41d07f5171 req-45c028af-8c49-4a75-90c6-8c7de72f34ea service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-changed-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:41:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-15bbc178-c601-4894-92be-cc41d07f5171 req-45c028af-8c49-4a75-90c6-8c7de72f34ea service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Refreshing instance network info cache due to event network-changed-db846f89-fbfe-4732-af40-f05c9e0842ad. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:41:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-15bbc178-c601-4894-92be-cc41d07f5171 req-45c028af-8c49-4a75-90c6-8c7de72f34ea service nova] Acquiring lock "refresh_cache-e2e5572a-5c09-4217-a5db-c05ebf3227e9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:40 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Successfully created port: f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Updating instance_info_cache with network_info: [{"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Releasing lock "refresh_cache-e2e5572a-5c09-4217-a5db-c05ebf3227e9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Instance network_info: |[{"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-15bbc178-c601-4894-92be-cc41d07f5171 req-45c028af-8c49-4a75-90c6-8c7de72f34ea service nova] Acquired lock "refresh_cache-e2e5572a-5c09-4217-a5db-c05ebf3227e9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.network.neutron [req-15bbc178-c601-4894-92be-cc41d07f5171 req-45c028af-8c49-4a75-90c6-8c7de72f34ea service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Refreshing network info cache for port db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Start _get_guest_xml network_info=[{"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Successfully created port: f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:41:41 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:41 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1657633063',display_name='tempest-DeleteServersTestJSON-server-1657633063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1657633063',id=2,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bedf64639896481fa1ab2f57fda22d85',ramdisk_id='',reservation_id='r-gks0dbjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-792701511',owner_user_name='tempest-DeleteServersTestJSON-792701511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:34Z,user_data=None,user_id='f012ed860c7c45f99300efaf9cc09145',uuid=e2e5572a-5c09-4217-a5db-c05ebf3227e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Converting VIF {"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:0b:2f,bridge_name='br-int',has_traffic_filtering=True,id=db846f89-fbfe-4732-af40-f05c9e0842ad,network=Network(9d5fb04e-2127-45c8-af85-e7b8021288b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb846f89-fb') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.objects.instance [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lazy-loading 'pci_devices' on Instance uuid e2e5572a-5c09-4217-a5db-c05ebf3227e9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:41:41 user nova-compute[73476]:   <uuid>e2e5572a-5c09-4217-a5db-c05ebf3227e9</uuid>
Aug 26 20:41:41 user nova-compute[73476]:   <name>instance-00000002</name>
Aug 26 20:41:41 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:41:41 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:41:41 user nova-compute[73476]:   <metadata>
Aug 26 20:41:41 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:41:41 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:41:41 user nova-compute[73476]:       <nova:name>tempest-DeleteServersTestJSON-server-1657633063</nova:name>
Aug 26 20:41:41 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:41:41</nova:creationTime>
Aug 26 20:41:41 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:41:41 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:41:41 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:41:41 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:41:41 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:41:41 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:41:41 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:41:41 user nova-compute[73476]:       <nova:owner>
Aug 26 20:41:41 user nova-compute[73476]:         <nova:user uuid="f012ed860c7c45f99300efaf9cc09145">tempest-DeleteServersTestJSON-792701511-project-member</nova:user>
Aug 26 20:41:41 user nova-compute[73476]:         <nova:project uuid="bedf64639896481fa1ab2f57fda22d85">tempest-DeleteServersTestJSON-792701511</nova:project>
Aug 26 20:41:41 user nova-compute[73476]:       </nova:owner>
Aug 26 20:41:41 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:41:41 user nova-compute[73476]:       <nova:ports>
Aug 26 20:41:41 user nova-compute[73476]:         <nova:port uuid="db846f89-fbfe-4732-af40-f05c9e0842ad">
Aug 26 20:41:41 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 20:41:41 user nova-compute[73476]:         </nova:port>
Aug 26 20:41:41 user nova-compute[73476]:       </nova:ports>
Aug 26 20:41:41 user nova-compute[73476]:     </nova:instance>
Aug 26 20:41:41 user nova-compute[73476]:   </metadata>
Aug 26 20:41:41 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:41:41 user nova-compute[73476]:     <system>
Aug 26 20:41:41 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:41:41 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:41:41 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:41:41 user nova-compute[73476]:       <entry name="serial">e2e5572a-5c09-4217-a5db-c05ebf3227e9</entry>
Aug 26 20:41:41 user nova-compute[73476]:       <entry name="uuid">e2e5572a-5c09-4217-a5db-c05ebf3227e9</entry>
Aug 26 20:41:41 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:41:41 user nova-compute[73476]:     </system>
Aug 26 20:41:41 user nova-compute[73476]:   </sysinfo>
Aug 26 20:41:41 user nova-compute[73476]:   <os>
Aug 26 20:41:41 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:41:41 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:41:41 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:41:41 user nova-compute[73476]:   </os>
Aug 26 20:41:41 user nova-compute[73476]:   <features>
Aug 26 20:41:41 user nova-compute[73476]:     <acpi/>
Aug 26 20:41:41 user nova-compute[73476]:     <apic/>
Aug 26 20:41:41 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:41:41 user nova-compute[73476]:   </features>
Aug 26 20:41:41 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:41:41 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:41:41 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:41:41 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:41:41 user nova-compute[73476]:   </clock>
Aug 26 20:41:41 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:41:41 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:41:41 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:41:41 user nova-compute[73476]:   </cpu>
Aug 26 20:41:41 user nova-compute[73476]:   <devices>
Aug 26 20:41:41 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:41:41 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:41:41 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk"/>
Aug 26 20:41:41 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:41:41 user nova-compute[73476]:     </disk>
Aug 26 20:41:41 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:41:41 user nova-compute[73476]:       <mac address="fa:16:3e:58:0b:2f"/>
Aug 26 20:41:41 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:41 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:41:41 user nova-compute[73476]:       <target dev="tapdb846f89-fb"/>
Aug 26 20:41:41 user nova-compute[73476]:     </interface>
Aug 26 20:41:41 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:41:41 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/console.log" append="off"/>
Aug 26 20:41:41 user nova-compute[73476]:     </serial>
Aug 26 20:41:41 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:41:41 user nova-compute[73476]:     <video>
Aug 26 20:41:41 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:41 user nova-compute[73476]:     </video>
Aug 26 20:41:41 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:41:41 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:41:41 user nova-compute[73476]:     </rng>
Aug 26 20:41:41 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:41:41 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:41:41 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:41:41 user nova-compute[73476]:     </memballoon>
Aug 26 20:41:41 user nova-compute[73476]:   </devices>
Aug 26 20:41:41 user nova-compute[73476]: </domain>
Aug 26 20:41:41 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1657633063',display_name='tempest-DeleteServersTestJSON-server-1657633063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1657633063',id=2,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bedf64639896481fa1ab2f57fda22d85',ramdisk_id='',reservation_id='r-gks0dbjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-792701511',owner_user_name='tempest-DeleteServersTestJSON-792701511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:34Z,user_data=None,user_id='f012ed860c7c45f99300efaf9cc09145',uuid=e2e5572a-5c09-4217-a5db-c05ebf3227e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Converting VIF {"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:0b:2f,bridge_name='br-int',has_traffic_filtering=True,id=db846f89-fbfe-4732-af40-f05c9e0842ad,network=Network(9d5fb04e-2127-45c8-af85-e7b8021288b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb846f89-fb') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG os_vif [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0b:2f,bridge_name='br-int',has_traffic_filtering=True,id=db846f89-fbfe-4732-af40-f05c9e0842ad,network=Network(9d5fb04e-2127-45c8-af85-e7b8021288b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb846f89-fb') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:41:41 user sudo[82812]: pam_unix(sudo:session): session closed for user root
Aug 26 20:41:41 user nova-compute[73476]: INFO oslo.privsep.daemon [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Spawned new privsep daemon via rootwrap
Aug 26 20:41:41 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 20:41:41 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 20:41:41 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 20:41:41 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82865
Aug 26 20:41:41 user nova-compute[73476]: WARNING oslo_privsep.priv_context [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] privsep daemon already running
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Successfully created port: b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27627bb2-3a, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27627bb2-3a, col_values=(('external_ids', {'iface-id': '27627bb2-3a27-4437-942f-3d72af60aad3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:b8:59', 'vm-uuid': '22b50300-8865-4854-b0c7-ed63ca60c85b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:42 user nova-compute[73476]: INFO os_vif [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:b8:59,bridge_name='br-int',has_traffic_filtering=True,id=27627bb2-3a27-4437-942f-3d72af60aad3,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27627bb2-3a')
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb846f89-fb, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb846f89-fb, col_values=(('external_ids', {'iface-id': 'db846f89-fbfe-4732-af40-f05c9e0842ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:0b:2f', 'vm-uuid': 'e2e5572a-5c09-4217-a5db-c05ebf3227e9'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:42 user nova-compute[73476]: INFO os_vif [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:0b:2f,bridge_name='br-int',has_traffic_filtering=True,id=db846f89-fbfe-4732-af40-f05c9e0842ad,network=Network(9d5fb04e-2127-45c8-af85-e7b8021288b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb846f89-fb')
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No VIF found with MAC fa:16:3e:66:b8:59, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] No VIF found with MAC fa:16:3e:58:0b:2f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.network.neutron [req-b912f898-4763-4407-a1ff-967e4fa7e9f3 req-4d5ade63-79a8-44cd-af1b-f06a2f63e66f service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updated VIF entry in instance network info cache for port 27627bb2-3a27-4437-942f-3d72af60aad3. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.network.neutron [req-b912f898-4763-4407-a1ff-967e4fa7e9f3 req-4d5ade63-79a8-44cd-af1b-f06a2f63e66f service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updating instance_info_cache with network_info: [{"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b912f898-4763-4407-a1ff-967e4fa7e9f3 req-4d5ade63-79a8-44cd-af1b-f06a2f63e66f service nova] Releasing lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.network.neutron [req-15bbc178-c601-4894-92be-cc41d07f5171 req-45c028af-8c49-4a75-90c6-8c7de72f34ea service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Updated VIF entry in instance network info cache for port db846f89-fbfe-4732-af40-f05c9e0842ad. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.network.neutron [req-15bbc178-c601-4894-92be-cc41d07f5171 req-45c028af-8c49-4a75-90c6-8c7de72f34ea service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Updating instance_info_cache with network_info: [{"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-15bbc178-c601-4894-92be-cc41d07f5171 req-45c028af-8c49-4a75-90c6-8c7de72f34ea service nova] Releasing lock "refresh_cache-e2e5572a-5c09-4217-a5db-c05ebf3227e9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Successfully created port: 15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Successfully updated port: f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquired lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-f6c435d3-fb7e-4b0d-ac06-ee6c355e9d20 req-1ebd0506-a6ab-4dd7-aebb-7cc325a05c0b service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-changed-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-f6c435d3-fb7e-4b0d-ac06-ee6c355e9d20 req-1ebd0506-a6ab-4dd7-aebb-7cc325a05c0b service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Refreshing instance network info cache due to event network-changed-f0b59e8a-1964-4699-81f4-6a9c3b08dae0. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f6c435d3-fb7e-4b0d-ac06-ee6c355e9d20 req-1ebd0506-a6ab-4dd7-aebb-7cc325a05c0b service nova] Acquiring lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance_info_cache with network_info: [{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Releasing lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance network_info: |[{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f6c435d3-fb7e-4b0d-ac06-ee6c355e9d20 req-1ebd0506-a6ab-4dd7-aebb-7cc325a05c0b service nova] Acquired lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.network.neutron [req-f6c435d3-fb7e-4b0d-ac06-ee6c355e9d20 req-1ebd0506-a6ab-4dd7-aebb-7cc325a05c0b service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Refreshing network info cache for port f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Start _get_guest_xml network_info=[{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:44 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-263678955',display_name='tempest-ServerActionsTestOtherB-server-263678955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-263678955',id=5,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6duovOgpoS/+TE0EH/fCNy+ilV5kxrulfvMaTJVTAkoOJVt3B0olv0pH7NT01fhQF+CMU3wUX3bGKgX/wKj8M/GNeOdqt2EwZ91VfdEmDAANieG8njlOp1SAEmAi7Ug==',key_name='tempest-keypair-1212818177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76a9f74cd94849f7a132c168b1ed5622',ramdisk_id='',reservation_id='r-ns6go6pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-42689020',owner_user_name='tempest-ServerActionsTestOtherB-42689020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18713e0a843f45f08cdb8d70e7cafeeb',uuid=ad42cf47-42fb-488f-a44f-cf9824dd4d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converting VIF {"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.objects.instance [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lazy-loading 'pci_devices' on Instance uuid ad42cf47-42fb-488f-a44f-cf9824dd4d99 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:41:44 user nova-compute[73476]:   <uuid>ad42cf47-42fb-488f-a44f-cf9824dd4d99</uuid>
Aug 26 20:41:44 user nova-compute[73476]:   <name>instance-00000005</name>
Aug 26 20:41:44 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:41:44 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:41:44 user nova-compute[73476]:   <metadata>
Aug 26 20:41:44 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:41:44 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:41:44 user nova-compute[73476]:       <nova:name>tempest-ServerActionsTestOtherB-server-263678955</nova:name>
Aug 26 20:41:44 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:41:44</nova:creationTime>
Aug 26 20:41:44 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:41:44 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:41:44 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:41:44 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:41:44 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:41:44 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:41:44 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:41:44 user nova-compute[73476]:       <nova:owner>
Aug 26 20:41:44 user nova-compute[73476]:         <nova:user uuid="18713e0a843f45f08cdb8d70e7cafeeb">tempest-ServerActionsTestOtherB-42689020-project-member</nova:user>
Aug 26 20:41:44 user nova-compute[73476]:         <nova:project uuid="76a9f74cd94849f7a132c168b1ed5622">tempest-ServerActionsTestOtherB-42689020</nova:project>
Aug 26 20:41:44 user nova-compute[73476]:       </nova:owner>
Aug 26 20:41:44 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:41:44 user nova-compute[73476]:       <nova:ports>
Aug 26 20:41:44 user nova-compute[73476]:         <nova:port uuid="f0b59e8a-1964-4699-81f4-6a9c3b08dae0">
Aug 26 20:41:44 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 20:41:44 user nova-compute[73476]:         </nova:port>
Aug 26 20:41:44 user nova-compute[73476]:       </nova:ports>
Aug 26 20:41:44 user nova-compute[73476]:     </nova:instance>
Aug 26 20:41:44 user nova-compute[73476]:   </metadata>
Aug 26 20:41:44 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:41:44 user nova-compute[73476]:     <system>
Aug 26 20:41:44 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:41:44 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:41:44 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:41:44 user nova-compute[73476]:       <entry name="serial">ad42cf47-42fb-488f-a44f-cf9824dd4d99</entry>
Aug 26 20:41:44 user nova-compute[73476]:       <entry name="uuid">ad42cf47-42fb-488f-a44f-cf9824dd4d99</entry>
Aug 26 20:41:44 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:41:44 user nova-compute[73476]:     </system>
Aug 26 20:41:44 user nova-compute[73476]:   </sysinfo>
Aug 26 20:41:44 user nova-compute[73476]:   <os>
Aug 26 20:41:44 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:41:44 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:41:44 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:41:44 user nova-compute[73476]:   </os>
Aug 26 20:41:44 user nova-compute[73476]:   <features>
Aug 26 20:41:44 user nova-compute[73476]:     <acpi/>
Aug 26 20:41:44 user nova-compute[73476]:     <apic/>
Aug 26 20:41:44 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:41:44 user nova-compute[73476]:   </features>
Aug 26 20:41:44 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:41:44 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:41:44 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:41:44 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:41:44 user nova-compute[73476]:   </clock>
Aug 26 20:41:44 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:41:44 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:41:44 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:41:44 user nova-compute[73476]:   </cpu>
Aug 26 20:41:44 user nova-compute[73476]:   <devices>
Aug 26 20:41:44 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:41:44 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:41:44 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk"/>
Aug 26 20:41:44 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:41:44 user nova-compute[73476]:     </disk>
Aug 26 20:41:44 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:41:44 user nova-compute[73476]:       <mac address="fa:16:3e:65:28:58"/>
Aug 26 20:41:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:44 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:41:44 user nova-compute[73476]:       <target dev="tapf0b59e8a-19"/>
Aug 26 20:41:44 user nova-compute[73476]:     </interface>
Aug 26 20:41:44 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:41:44 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/console.log" append="off"/>
Aug 26 20:41:44 user nova-compute[73476]:     </serial>
Aug 26 20:41:44 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:41:44 user nova-compute[73476]:     <video>
Aug 26 20:41:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:44 user nova-compute[73476]:     </video>
Aug 26 20:41:44 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:41:44 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:41:44 user nova-compute[73476]:     </rng>
Aug 26 20:41:44 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:41:44 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:41:44 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:41:44 user nova-compute[73476]:     </memballoon>
Aug 26 20:41:44 user nova-compute[73476]:   </devices>
Aug 26 20:41:44 user nova-compute[73476]: </domain>
Aug 26 20:41:44 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-263678955',display_name='tempest-ServerActionsTestOtherB-server-263678955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-263678955',id=5,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6duovOgpoS/+TE0EH/fCNy+ilV5kxrulfvMaTJVTAkoOJVt3B0olv0pH7NT01fhQF+CMU3wUX3bGKgX/wKj8M/GNeOdqt2EwZ91VfdEmDAANieG8njlOp1SAEmAi7Ug==',key_name='tempest-keypair-1212818177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76a9f74cd94849f7a132c168b1ed5622',ramdisk_id='',reservation_id='r-ns6go6pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-42689020',owner_user_name='tempest-ServerActionsTestOtherB-42689020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18713e0a843f45f08cdb8d70e7cafeeb',uuid=ad42cf47-42fb-488f-a44f-cf9824dd4d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converting VIF {"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG os_vif [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0b59e8a-19, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0b59e8a-19, col_values=(('external_ids', {'iface-id': 'f0b59e8a-1964-4699-81f4-6a9c3b08dae0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:28:58', 'vm-uuid': 'ad42cf47-42fb-488f-a44f-cf9824dd4d99'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: INFO os_vif [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19')
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] No VIF found with MAC fa:16:3e:65:28:58, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Successfully updated port: f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:41:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquired lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:41:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-d968d68f-5dd4-419b-a755-b8722e053861 req-f48bcf50-298c-44bc-a596-387d22a4382a service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-changed-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:41:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-d968d68f-5dd4-419b-a755-b8722e053861 req-f48bcf50-298c-44bc-a596-387d22a4382a service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Refreshing instance network info cache due to event network-changed-f21f3f69-c470-4a8e-9166-7b8a4dee07fb. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:41:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d968d68f-5dd4-419b-a755-b8722e053861 req-f48bcf50-298c-44bc-a596-387d22a4382a service nova] Acquiring lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-f6c435d3-fb7e-4b0d-ac06-ee6c355e9d20 req-1ebd0506-a6ab-4dd7-aebb-7cc325a05c0b service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updated VIF entry in instance network info cache for port f0b59e8a-1964-4699-81f4-6a9c3b08dae0. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-f6c435d3-fb7e-4b0d-ac06-ee6c355e9d20 req-1ebd0506-a6ab-4dd7-aebb-7cc325a05c0b service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance_info_cache with network_info: [{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f6c435d3-fb7e-4b0d-ac06-ee6c355e9d20 req-1ebd0506-a6ab-4dd7-aebb-7cc325a05c0b service nova] Releasing lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Successfully updated port: b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquired lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Successfully updated port: 15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquired lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updating instance_info_cache with network_info: [{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Releasing lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Instance network_info: |[{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d968d68f-5dd4-419b-a755-b8722e053861 req-f48bcf50-298c-44bc-a596-387d22a4382a service nova] Acquired lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.network.neutron [req-d968d68f-5dd4-419b-a755-b8722e053861 req-f48bcf50-298c-44bc-a596-387d22a4382a service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Refreshing network info cache for port f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Start _get_guest_xml network_info=[{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:47 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:47 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1167118621',display_name='tempest-ServerRescueNegativeTestJSON-server-1167118621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1167118621',id=3,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-j4eiyvfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:36Z,user_data=None,user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=531953d6-502b-4f11-8a53-0bf267bec1f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f21f3f69-c470-4a8e-9166-7b8a4dee07fb,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21f3f69-c4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'pci_devices' on Instance uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:41:47 user nova-compute[73476]:   <uuid>531953d6-502b-4f11-8a53-0bf267bec1f0</uuid>
Aug 26 20:41:47 user nova-compute[73476]:   <name>instance-00000003</name>
Aug 26 20:41:47 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:41:47 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:41:47 user nova-compute[73476]:   <metadata>
Aug 26 20:41:47 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:41:47 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:41:47 user nova-compute[73476]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1167118621</nova:name>
Aug 26 20:41:47 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:41:47</nova:creationTime>
Aug 26 20:41:47 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:41:47 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:41:47 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:41:47 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:41:47 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:41:47 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:41:47 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:41:47 user nova-compute[73476]:       <nova:owner>
Aug 26 20:41:47 user nova-compute[73476]:         <nova:user uuid="eb63707c9d734bf5b1d1bb20162e3204">tempest-ServerRescueNegativeTestJSON-552908196-project-member</nova:user>
Aug 26 20:41:47 user nova-compute[73476]:         <nova:project uuid="c713d9f0cc5f4dd7a8629ba1b27e72f0">tempest-ServerRescueNegativeTestJSON-552908196</nova:project>
Aug 26 20:41:47 user nova-compute[73476]:       </nova:owner>
Aug 26 20:41:47 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:41:47 user nova-compute[73476]:       <nova:ports>
Aug 26 20:41:47 user nova-compute[73476]:         <nova:port uuid="f21f3f69-c470-4a8e-9166-7b8a4dee07fb">
Aug 26 20:41:47 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 20:41:47 user nova-compute[73476]:         </nova:port>
Aug 26 20:41:47 user nova-compute[73476]:       </nova:ports>
Aug 26 20:41:47 user nova-compute[73476]:     </nova:instance>
Aug 26 20:41:47 user nova-compute[73476]:   </metadata>
Aug 26 20:41:47 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:41:47 user nova-compute[73476]:     <system>
Aug 26 20:41:47 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:41:47 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:41:47 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:41:47 user nova-compute[73476]:       <entry name="serial">531953d6-502b-4f11-8a53-0bf267bec1f0</entry>
Aug 26 20:41:47 user nova-compute[73476]:       <entry name="uuid">531953d6-502b-4f11-8a53-0bf267bec1f0</entry>
Aug 26 20:41:47 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:41:47 user nova-compute[73476]:     </system>
Aug 26 20:41:47 user nova-compute[73476]:   </sysinfo>
Aug 26 20:41:47 user nova-compute[73476]:   <os>
Aug 26 20:41:47 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:41:47 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:41:47 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:41:47 user nova-compute[73476]:   </os>
Aug 26 20:41:47 user nova-compute[73476]:   <features>
Aug 26 20:41:47 user nova-compute[73476]:     <acpi/>
Aug 26 20:41:47 user nova-compute[73476]:     <apic/>
Aug 26 20:41:47 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:41:47 user nova-compute[73476]:   </features>
Aug 26 20:41:47 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:41:47 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:41:47 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:41:47 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:41:47 user nova-compute[73476]:   </clock>
Aug 26 20:41:47 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:41:47 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:41:47 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:41:47 user nova-compute[73476]:   </cpu>
Aug 26 20:41:47 user nova-compute[73476]:   <devices>
Aug 26 20:41:47 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:41:47 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:41:47 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk"/>
Aug 26 20:41:47 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:41:47 user nova-compute[73476]:     </disk>
Aug 26 20:41:47 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:41:47 user nova-compute[73476]:       <mac address="fa:16:3e:00:c3:ed"/>
Aug 26 20:41:47 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:47 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:41:47 user nova-compute[73476]:       <target dev="tapf21f3f69-c4"/>
Aug 26 20:41:47 user nova-compute[73476]:     </interface>
Aug 26 20:41:47 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:41:47 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/console.log" append="off"/>
Aug 26 20:41:47 user nova-compute[73476]:     </serial>
Aug 26 20:41:47 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:41:47 user nova-compute[73476]:     <video>
Aug 26 20:41:47 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:47 user nova-compute[73476]:     </video>
Aug 26 20:41:47 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:41:47 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:41:47 user nova-compute[73476]:     </rng>
Aug 26 20:41:47 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:41:47 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:41:47 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:41:47 user nova-compute[73476]:     </memballoon>
Aug 26 20:41:47 user nova-compute[73476]:   </devices>
Aug 26 20:41:47 user nova-compute[73476]: </domain>
Aug 26 20:41:47 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1167118621',display_name='tempest-ServerRescueNegativeTestJSON-server-1167118621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1167118621',id=3,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-j4eiyvfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:36Z,user_data=None,user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=531953d6-502b-4f11-8a53-0bf267bec1f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f21f3f69-c470-4a8e-9166-7b8a4dee07fb,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21f3f69-c4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG os_vif [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f21f3f69-c470-4a8e-9166-7b8a4dee07fb,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21f3f69-c4') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf21f3f69-c4, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf21f3f69-c4, col_values=(('external_ids', {'iface-id': 'f21f3f69-c470-4a8e-9166-7b8a4dee07fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:c3:ed', 'vm-uuid': '531953d6-502b-4f11-8a53-0bf267bec1f0'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:47 user nova-compute[73476]: INFO os_vif [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f21f3f69-c470-4a8e-9166-7b8a4dee07fb,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21f3f69-c4')
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No VIF found with MAC fa:16:3e:00:c3:ed, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received event network-changed-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Refreshing instance network info cache due to event network-changed-b6751288-099f-4014-9eaa-40b28f0baec4. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] Acquiring lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Updating instance_info_cache with network_info: [{"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Releasing lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Instance network_info: |[{"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] Acquired lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.network.neutron [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Refreshing network info cache for port b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:41:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Start _get_guest_xml network_info=[{"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:41:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1359566345',display_name='tempest-ServerActionsTestOtherA-server-1359566345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1359566345',id=4,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrUMTyGNKdGpzDsrysQPohyAkRqtJhi3sdBZorTU8L/A2dHf0ht3Zah6gdCoAeVQTlLTdvxBfzTJPbHDiEF3xFnMtXTZ/YbW5aEqOqGzGXK2CkdK6c5/YxdHT2BmY6wkQ==',key_name='tempest-keypair-2137585327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-9wz6crun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=215be88c-8470-453f-b293-ce98148be308,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=b6751288-099f-4014-9eaa-40b28f0baec4,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6751288-09') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'pci_devices' on Instance uuid 215be88c-8470-453f-b293-ce98148be308 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:41:48 user nova-compute[73476]:   <uuid>215be88c-8470-453f-b293-ce98148be308</uuid>
Aug 26 20:41:48 user nova-compute[73476]:   <name>instance-00000004</name>
Aug 26 20:41:48 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:41:48 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:41:48 user nova-compute[73476]:   <metadata>
Aug 26 20:41:48 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:41:48 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:name>tempest-ServerActionsTestOtherA-server-1359566345</nova:name>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:41:48</nova:creationTime>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:41:48 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:41:48 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:owner>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:user uuid="fdf18fb0dcd64e11a7e42cc5184a219e">tempest-ServerActionsTestOtherA-1600580756-project-member</nova:user>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:project uuid="b16d8f644f0442fea1f8a57961111a30">tempest-ServerActionsTestOtherA-1600580756</nova:project>
Aug 26 20:41:48 user nova-compute[73476]:       </nova:owner>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:ports>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:port uuid="b6751288-099f-4014-9eaa-40b28f0baec4">
Aug 26 20:41:48 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 20:41:48 user nova-compute[73476]:         </nova:port>
Aug 26 20:41:48 user nova-compute[73476]:       </nova:ports>
Aug 26 20:41:48 user nova-compute[73476]:     </nova:instance>
Aug 26 20:41:48 user nova-compute[73476]:   </metadata>
Aug 26 20:41:48 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:41:48 user nova-compute[73476]:     <system>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="serial">215be88c-8470-453f-b293-ce98148be308</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="uuid">215be88c-8470-453f-b293-ce98148be308</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:41:48 user nova-compute[73476]:     </system>
Aug 26 20:41:48 user nova-compute[73476]:   </sysinfo>
Aug 26 20:41:48 user nova-compute[73476]:   <os>
Aug 26 20:41:48 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:41:48 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:41:48 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:41:48 user nova-compute[73476]:   </os>
Aug 26 20:41:48 user nova-compute[73476]:   <features>
Aug 26 20:41:48 user nova-compute[73476]:     <acpi/>
Aug 26 20:41:48 user nova-compute[73476]:     <apic/>
Aug 26 20:41:48 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:41:48 user nova-compute[73476]:   </features>
Aug 26 20:41:48 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:41:48 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:41:48 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:41:48 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:41:48 user nova-compute[73476]:   </clock>
Aug 26 20:41:48 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:41:48 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:41:48 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:41:48 user nova-compute[73476]:   </cpu>
Aug 26 20:41:48 user nova-compute[73476]:   <devices>
Aug 26 20:41:48 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:41:48 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:41:48 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk"/>
Aug 26 20:41:48 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:41:48 user nova-compute[73476]:     </disk>
Aug 26 20:41:48 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:41:48 user nova-compute[73476]:       <mac address="fa:16:3e:c4:78:7d"/>
Aug 26 20:41:48 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:48 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:41:48 user nova-compute[73476]:       <target dev="tapb6751288-09"/>
Aug 26 20:41:48 user nova-compute[73476]:     </interface>
Aug 26 20:41:48 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:41:48 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/console.log" append="off"/>
Aug 26 20:41:48 user nova-compute[73476]:     </serial>
Aug 26 20:41:48 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:41:48 user nova-compute[73476]:     <video>
Aug 26 20:41:48 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:48 user nova-compute[73476]:     </video>
Aug 26 20:41:48 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:41:48 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:41:48 user nova-compute[73476]:     </rng>
Aug 26 20:41:48 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:41:48 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:41:48 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:41:48 user nova-compute[73476]:     </memballoon>
Aug 26 20:41:48 user nova-compute[73476]:   </devices>
Aug 26 20:41:48 user nova-compute[73476]: </domain>
Aug 26 20:41:48 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1359566345',display_name='tempest-ServerActionsTestOtherA-server-1359566345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1359566345',id=4,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrUMTyGNKdGpzDsrysQPohyAkRqtJhi3sdBZorTU8L/A2dHf0ht3Zah6gdCoAeVQTlLTdvxBfzTJPbHDiEF3xFnMtXTZ/YbW5aEqOqGzGXK2CkdK6c5/YxdHT2BmY6wkQ==',key_name='tempest-keypair-2137585327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-9wz6crun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=215be88c-8470-453f-b293-ce98148be308,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=b6751288-099f-4014-9eaa-40b28f0baec4,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6751288-09') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG os_vif [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=b6751288-099f-4014-9eaa-40b28f0baec4,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6751288-09') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6751288-09, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6751288-09, col_values=(('external_ids', {'iface-id': 'b6751288-099f-4014-9eaa-40b28f0baec4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:78:7d', 'vm-uuid': '215be88c-8470-453f-b293-ce98148be308'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:48 user nova-compute[73476]: INFO os_vif [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=b6751288-099f-4014-9eaa-40b28f0baec4,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6751288-09')
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No VIF found with MAC fa:16:3e:c4:78:7d, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Updating instance_info_cache with network_info: [{"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Releasing lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Instance network_info: |[{"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Start _get_guest_xml network_info=[{"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082508.562349, e2e5572a-5c09-4217-a5db-c05ebf3227e9 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] VM Resumed (Lifecycle Event)
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:41:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:41:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Instance spawned successfully.
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1730290434',display_name='tempest-ServerRescueNegativeTestJSON-server-1730290434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1730290434',id=6,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-kr1306y7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:38Z,user_data=None,user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=13e8971f-2d6c-4f8e-b895-411db3554e74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4f:0e,bridge_name='br-int',has_traffic_filtering=True,id=15b711e1-203e-49ef-b25b-fac751706ef3,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b711e1-20') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.objects.instance [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'pci_devices' on Instance uuid 13e8971f-2d6c-4f8e-b895-411db3554e74 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:41:48 user nova-compute[73476]:   <uuid>13e8971f-2d6c-4f8e-b895-411db3554e74</uuid>
Aug 26 20:41:48 user nova-compute[73476]:   <name>instance-00000006</name>
Aug 26 20:41:48 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:41:48 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:41:48 user nova-compute[73476]:   <metadata>
Aug 26 20:41:48 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:41:48 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1730290434</nova:name>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:41:48</nova:creationTime>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:41:48 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:41:48 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:owner>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:user uuid="eb63707c9d734bf5b1d1bb20162e3204">tempest-ServerRescueNegativeTestJSON-552908196-project-member</nova:user>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:project uuid="c713d9f0cc5f4dd7a8629ba1b27e72f0">tempest-ServerRescueNegativeTestJSON-552908196</nova:project>
Aug 26 20:41:48 user nova-compute[73476]:       </nova:owner>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:41:48 user nova-compute[73476]:       <nova:ports>
Aug 26 20:41:48 user nova-compute[73476]:         <nova:port uuid="15b711e1-203e-49ef-b25b-fac751706ef3">
Aug 26 20:41:48 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 20:41:48 user nova-compute[73476]:         </nova:port>
Aug 26 20:41:48 user nova-compute[73476]:       </nova:ports>
Aug 26 20:41:48 user nova-compute[73476]:     </nova:instance>
Aug 26 20:41:48 user nova-compute[73476]:   </metadata>
Aug 26 20:41:48 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:41:48 user nova-compute[73476]:     <system>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="serial">13e8971f-2d6c-4f8e-b895-411db3554e74</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="uuid">13e8971f-2d6c-4f8e-b895-411db3554e74</entry>
Aug 26 20:41:48 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:41:48 user nova-compute[73476]:     </system>
Aug 26 20:41:48 user nova-compute[73476]:   </sysinfo>
Aug 26 20:41:48 user nova-compute[73476]:   <os>
Aug 26 20:41:48 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:41:48 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:41:48 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:41:48 user nova-compute[73476]:   </os>
Aug 26 20:41:48 user nova-compute[73476]:   <features>
Aug 26 20:41:48 user nova-compute[73476]:     <acpi/>
Aug 26 20:41:48 user nova-compute[73476]:     <apic/>
Aug 26 20:41:48 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:41:48 user nova-compute[73476]:   </features>
Aug 26 20:41:48 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:41:48 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:41:48 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:41:48 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:41:48 user nova-compute[73476]:   </clock>
Aug 26 20:41:48 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:41:48 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:41:48 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:41:48 user nova-compute[73476]:   </cpu>
Aug 26 20:41:48 user nova-compute[73476]:   <devices>
Aug 26 20:41:48 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:41:48 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:41:48 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk"/>
Aug 26 20:41:48 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:41:48 user nova-compute[73476]:     </disk>
Aug 26 20:41:48 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:41:48 user nova-compute[73476]:       <mac address="fa:16:3e:a8:4f:0e"/>
Aug 26 20:41:48 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:48 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:41:48 user nova-compute[73476]:       <target dev="tap15b711e1-20"/>
Aug 26 20:41:48 user nova-compute[73476]:     </interface>
Aug 26 20:41:48 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:41:48 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/console.log" append="off"/>
Aug 26 20:41:48 user nova-compute[73476]:     </serial>
Aug 26 20:41:48 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:41:48 user nova-compute[73476]:     <video>
Aug 26 20:41:48 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:41:48 user nova-compute[73476]:     </video>
Aug 26 20:41:48 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:41:48 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:41:48 user nova-compute[73476]:     </rng>
Aug 26 20:41:48 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:41:48 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:41:48 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:41:48 user nova-compute[73476]:     </memballoon>
Aug 26 20:41:48 user nova-compute[73476]:   </devices>
Aug 26 20:41:48 user nova-compute[73476]: </domain>
Aug 26 20:41:48 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1730290434',display_name='tempest-ServerRescueNegativeTestJSON-server-1730290434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1730290434',id=6,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-kr1306y7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:38Z,user_data=None,user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=13e8971f-2d6c-4f8e-b895-411db3554e74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4f:0e,bridge_name='br-int',has_traffic_filtering=True,id=15b711e1-203e-49ef-b25b-fac751706ef3,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b711e1-20') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG os_vif [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4f:0e,bridge_name='br-int',has_traffic_filtering=True,id=15b711e1-203e-49ef-b25b-fac751706ef3,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b711e1-20') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15b711e1-20, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15b711e1-20, col_values=(('external_ids', {'iface-id': '15b711e1-203e-49ef-b25b-fac751706ef3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:4f:0e', 'vm-uuid': '13e8971f-2d6c-4f8e-b895-411db3554e74'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:41:48 user nova-compute[73476]: INFO os_vif [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4f:0e,bridge_name='br-int',has_traffic_filtering=True,id=15b711e1-203e-49ef-b25b-fac751706ef3,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b711e1-20')
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082508.5627873, e2e5572a-5c09-4217-a5db-c05ebf3227e9 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] VM Started (Lifecycle Event)
Aug 26 20:41:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No VIF found with MAC fa:16:3e:a8:4f:0e, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:41:48 user nova-compute[73476]: INFO nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Took 14.96 seconds to spawn the instance on the hypervisor.
Aug 26 20:41:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-d968d68f-5dd4-419b-a755-b8722e053861 req-f48bcf50-298c-44bc-a596-387d22a4382a service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updated VIF entry in instance network info cache for port f21f3f69-c470-4a8e-9166-7b8a4dee07fb. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-d968d68f-5dd4-419b-a755-b8722e053861 req-f48bcf50-298c-44bc-a596-387d22a4382a service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updating instance_info_cache with network_info: [{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d968d68f-5dd4-419b-a755-b8722e053861 req-f48bcf50-298c-44bc-a596-387d22a4382a service nova] Releasing lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Updated VIF entry in instance network info cache for port b6751288-099f-4014-9eaa-40b28f0baec4. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Updating instance_info_cache with network_info: [{"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] Releasing lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-changed-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Refreshing instance network info cache due to event network-changed-15b711e1-203e-49ef-b25b-fac751706ef3. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] Acquiring lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] Acquired lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Refreshing network info cache for port 15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:41:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Instance spawned successfully.
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:50 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082509.9743764, 22b50300-8865-4854-b0c7-ed63ca60c85b => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:50 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] VM Resumed (Lifecycle Event)
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:50 user nova-compute[73476]: INFO nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Took 22.76 seconds to spawn the instance on the hypervisor.
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:50 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082509.9859228, 22b50300-8865-4854-b0c7-ed63ca60c85b => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:50 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] VM Started (Lifecycle Event)
Aug 26 20:41:50 user nova-compute[73476]: INFO nova.compute.manager [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Took 17.01 seconds to build instance.
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:50 user nova-compute[73476]: INFO nova.compute.manager [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Took 23.62 seconds to build instance.
Aug 26 20:41:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-13b94086-292f-444d-8253-9b96e561661d tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.332s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c1cac24a-b0ef-4fc7-9448-6d8c13a03a7a tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.884s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Updated VIF entry in instance network info cache for port 15b711e1-203e-49ef-b25b-fac751706ef3. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:41:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Updating instance_info_cache with network_info: [{"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:41:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cf16f08c-bf10-43e3-845a-e8ac460f2164 req-a7ffee7e-7cf5-4607-a097-b4ffddf6de1f service nova] Releasing lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:41:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-ccb98d11-1e04-4fc4-a12b-06f30649dff0 req-2cb0d081-796e-4b26-9f5d-f01c09446b25 service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received event network-vif-plugged-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ccb98d11-1e04-4fc4-a12b-06f30649dff0 req-2cb0d081-796e-4b26-9f5d-f01c09446b25 service nova] Acquiring lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ccb98d11-1e04-4fc4-a12b-06f30649dff0 req-2cb0d081-796e-4b26-9f5d-f01c09446b25 service nova] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ccb98d11-1e04-4fc4-a12b-06f30649dff0 req-2cb0d081-796e-4b26-9f5d-f01c09446b25 service nova] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-ccb98d11-1e04-4fc4-a12b-06f30649dff0 req-2cb0d081-796e-4b26-9f5d-f01c09446b25 service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] No waiting events found dispatching network-vif-plugged-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:41:52 user nova-compute[73476]: WARNING nova.compute.manager [req-ccb98d11-1e04-4fc4-a12b-06f30649dff0 req-2cb0d081-796e-4b26-9f5d-f01c09446b25 service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received unexpected event network-vif-plugged-27627bb2-3a27-4437-942f-3d72af60aad3 for instance with vm_state active and task_state None.
Aug 26 20:41:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082514.4905155, ad42cf47-42fb-488f-a44f-cf9824dd4d99 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:54 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] VM Resumed (Lifecycle Event)
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:41:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance spawned successfully.
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:54 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082514.494378, ad42cf47-42fb-488f-a44f-cf9824dd4d99 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:54 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] VM Started (Lifecycle Event)
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:54 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:41:54 user nova-compute[73476]: INFO nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Took 16.97 seconds to spawn the instance on the hypervisor.
Aug 26 20:41:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-007b49ba-5035-4161-a172-9ca88d839649 req-a3228bb9-80eb-44ef-ab90-37a9bb313e8a service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received event network-vif-plugged-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:41:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-007b49ba-5035-4161-a172-9ca88d839649 req-a3228bb9-80eb-44ef-ab90-37a9bb313e8a service nova] Acquiring lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-007b49ba-5035-4161-a172-9ca88d839649 req-a3228bb9-80eb-44ef-ab90-37a9bb313e8a service nova] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-007b49ba-5035-4161-a172-9ca88d839649 req-a3228bb9-80eb-44ef-ab90-37a9bb313e8a service nova] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-007b49ba-5035-4161-a172-9ca88d839649 req-a3228bb9-80eb-44ef-ab90-37a9bb313e8a service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] No waiting events found dispatching network-vif-plugged-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:41:55 user nova-compute[73476]: WARNING nova.compute.manager [req-007b49ba-5035-4161-a172-9ca88d839649 req-a3228bb9-80eb-44ef-ab90-37a9bb313e8a service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received unexpected event network-vif-plugged-27627bb2-3a27-4437-942f-3d72af60aad3 for instance with vm_state active and task_state None.
Aug 26 20:41:55 user nova-compute[73476]: INFO nova.compute.manager [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Took 18.09 seconds to build instance.
Aug 26 20:41:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5e68f5f2-15b6-4b65-8411-1cfe2dfd34b6 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.264s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082517.0481117, 215be88c-8470-453f-b293-ce98148be308 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] VM Resumed (Lifecycle Event)
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 215be88c-8470-453f-b293-ce98148be308] Instance spawned successfully.
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Instance spawned successfully.
Aug 26 20:41:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Instance spawned successfully.
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082517.0647526, 215be88c-8470-453f-b293-ce98148be308 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] VM Started (Lifecycle Event)
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Took 20.98 seconds to spawn the instance on the hypervisor.
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082517.1072464, 531953d6-502b-4f11-8a53-0bf267bec1f0 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] VM Resumed (Lifecycle Event)
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Took 20.53 seconds to spawn the instance on the hypervisor.
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Took 22.37 seconds to build instance.
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082517.1081803, 13e8971f-2d6c-4f8e-b895-411db3554e74 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] VM Resumed (Lifecycle Event)
Aug 26 20:41:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-34c67a14-d831-428d-89d0-a57dfd4fbe95 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.573s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Took 19.29 seconds to spawn the instance on the hypervisor.
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:57 user nova-compute[73476]: INFO nova.compute.manager [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Took 20.84 seconds to build instance.
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082517.1103337, 531953d6-502b-4f11-8a53-0bf267bec1f0 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:58 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] VM Started (Lifecycle Event)
Aug 26 20:41:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5ba3c7a0-c346-4d27-be25-96c2fac736c2 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.026s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:58 user nova-compute[73476]: INFO nova.compute.manager [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Took 22.31 seconds to build instance.
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082517.1168873, 13e8971f-2d6c-4f8e-b895-411db3554e74 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:41:58 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] VM Started (Lifecycle Event)
Aug 26 20:41:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4160c86b-3ef6-47b1-9091-78376bd87d7f tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "215be88c-8470-453f-b293-ce98148be308" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.867s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:41:58 user nova-compute[73476]: INFO nova.compute.claims [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Claim successful on node user
Aug 26 20:41:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:41:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:41:58 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:41:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG nova.policy [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f2bee4738d4442fabd6c6a802070555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b92247b70b4ef6ab0d4bbb6a8a60f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:41:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Creating image(s)
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "/opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "/opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "/opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.486s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-a33e1a29-2c42-46a5-b5fb-177b85d9e8e3 req-c280dc97-8740-4a0c-90d8-69867f1f2b5c service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a33e1a29-2c42-46a5-b5fb-177b85d9e8e3 req-c280dc97-8740-4a0c-90d8-69867f1f2b5c service nova] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a33e1a29-2c42-46a5-b5fb-177b85d9e8e3 req-c280dc97-8740-4a0c-90d8-69867f1f2b5c service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a33e1a29-2c42-46a5-b5fb-177b85d9e8e3 req-c280dc97-8740-4a0c-90d8-69867f1f2b5c service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:41:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-a33e1a29-2c42-46a5-b5fb-177b85d9e8e3 req-c280dc97-8740-4a0c-90d8-69867f1f2b5c service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] No waiting events found dispatching network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:41:59 user nova-compute[73476]: WARNING nova.compute.manager [req-a33e1a29-2c42-46a5-b5fb-177b85d9e8e3 req-c280dc97-8740-4a0c-90d8-69867f1f2b5c service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received unexpected event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 for instance with vm_state active and task_state None.
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.324s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk 1073741824" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.522s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Successfully created port: 5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.254s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.389s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Cannot resize image /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Successfully updated port: 5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "refresh_cache-22c72de3-e06b-4aae-bed9-162101a43e6f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquired lock "refresh_cache-22c72de3-e06b-4aae-bed9-162101a43e6f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-d75a7baa-4b7a-4e5d-8679-21247e6f344e req-4347c434-2873-4701-a179-2ae62a0a59a8 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-changed-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-d75a7baa-4b7a-4e5d-8679-21247e6f344e req-4347c434-2873-4701-a179-2ae62a0a59a8 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Refreshing instance network info cache due to event network-changed-5378ea4f-5e56-4d66-a742-9b132fbc6160. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d75a7baa-4b7a-4e5d-8679-21247e6f344e req-4347c434-2873-4701-a179-2ae62a0a59a8 service nova] Acquiring lock "refresh_cache-22c72de3-e06b-4aae-bed9-162101a43e6f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] No waiting events found dispatching network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:02 user nova-compute[73476]: WARNING nova.compute.manager [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received unexpected event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 for instance with vm_state active and task_state None.
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received event network-vif-plugged-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] Acquiring lock "215be88c-8470-453f-b293-ce98148be308-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] Lock "215be88c-8470-453f-b293-ce98148be308-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] Lock "215be88c-8470-453f-b293-ce98148be308-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] No waiting events found dispatching network-vif-plugged-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:02 user nova-compute[73476]: WARNING nova.compute.manager [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received unexpected event network-vif-plugged-b6751288-099f-4014-9eaa-40b28f0baec4 for instance with vm_state active and task_state None.
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received event network-vif-plugged-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] Acquiring lock "215be88c-8470-453f-b293-ce98148be308-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] Lock "215be88c-8470-453f-b293-ce98148be308-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] Lock "215be88c-8470-453f-b293-ce98148be308-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] No waiting events found dispatching network-vif-plugged-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:02 user nova-compute[73476]: WARNING nova.compute.manager [req-b0277399-c47d-4fff-a042-2cfeec3f4509 req-daaf8180-8b2b-4b39-be38-a7dc5ef93274 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received unexpected event network-vif-plugged-b6751288-099f-4014-9eaa-40b28f0baec4 for instance with vm_state active and task_state None.
Aug 26 20:42:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Updating instance_info_cache with network_info: [{"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Releasing lock "refresh_cache-22c72de3-e06b-4aae-bed9-162101a43e6f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Instance network_info: |[{"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d75a7baa-4b7a-4e5d-8679-21247e6f344e req-4347c434-2873-4701-a179-2ae62a0a59a8 service nova] Acquired lock "refresh_cache-22c72de3-e06b-4aae-bed9-162101a43e6f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-d75a7baa-4b7a-4e5d-8679-21247e6f344e req-4347c434-2873-4701-a179-2ae62a0a59a8 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Refreshing network info cache for port 5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Start _get_guest_xml network_info=[{"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:42:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1272776851',display_name='tempest-VolumesAdminNegativeTest-server-1272776851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1272776851',id=7,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPd6S7mvw3TVXiOJ1xSq8JXRA05KgKlnD6kKubB6f+v8PlZc2rmU/hXdW8ntPBsNU7gSNc20+3JGqxYrI+O0kcs07XlKsU5IVPczin/QAeIUMTFwCzWo1i1ppjsPKrfxw==',key_name='tempest-keypair-182732187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0b92247b70b4ef6ab0d4bbb6a8a60f0',ramdisk_id='',reservation_id='r-ey2pn8ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1926983424',owner_user_name='tempest-VolumesAdminNegativeTest-1926983424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2bee4738d4442fabd6c6a802070555',uuid=22c72de3-e06b-4aae-bed9-162101a43e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converting VIF {"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:7f:fd,bridge_name='br-int',has_traffic_filtering=True,id=5378ea4f-5e56-4d66-a742-9b132fbc6160,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5378ea4f-5e') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.objects.instance [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lazy-loading 'pci_devices' on Instance uuid 22c72de3-e06b-4aae-bed9-162101a43e6f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:42:03 user nova-compute[73476]:   <uuid>22c72de3-e06b-4aae-bed9-162101a43e6f</uuid>
Aug 26 20:42:03 user nova-compute[73476]:   <name>instance-00000007</name>
Aug 26 20:42:03 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:42:03 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:42:03 user nova-compute[73476]:   <metadata>
Aug 26 20:42:03 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:42:03 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:42:03 user nova-compute[73476]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1272776851</nova:name>
Aug 26 20:42:03 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:42:03</nova:creationTime>
Aug 26 20:42:03 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:42:03 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:42:03 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:42:03 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:42:03 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:42:03 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:42:03 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:42:03 user nova-compute[73476]:       <nova:owner>
Aug 26 20:42:03 user nova-compute[73476]:         <nova:user uuid="0f2bee4738d4442fabd6c6a802070555">tempest-VolumesAdminNegativeTest-1926983424-project-member</nova:user>
Aug 26 20:42:03 user nova-compute[73476]:         <nova:project uuid="f0b92247b70b4ef6ab0d4bbb6a8a60f0">tempest-VolumesAdminNegativeTest-1926983424</nova:project>
Aug 26 20:42:03 user nova-compute[73476]:       </nova:owner>
Aug 26 20:42:03 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:42:03 user nova-compute[73476]:       <nova:ports>
Aug 26 20:42:03 user nova-compute[73476]:         <nova:port uuid="5378ea4f-5e56-4d66-a742-9b132fbc6160">
Aug 26 20:42:03 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 20:42:03 user nova-compute[73476]:         </nova:port>
Aug 26 20:42:03 user nova-compute[73476]:       </nova:ports>
Aug 26 20:42:03 user nova-compute[73476]:     </nova:instance>
Aug 26 20:42:03 user nova-compute[73476]:   </metadata>
Aug 26 20:42:03 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:42:03 user nova-compute[73476]:     <system>
Aug 26 20:42:03 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:42:03 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:42:03 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:42:03 user nova-compute[73476]:       <entry name="serial">22c72de3-e06b-4aae-bed9-162101a43e6f</entry>
Aug 26 20:42:03 user nova-compute[73476]:       <entry name="uuid">22c72de3-e06b-4aae-bed9-162101a43e6f</entry>
Aug 26 20:42:03 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:42:03 user nova-compute[73476]:     </system>
Aug 26 20:42:03 user nova-compute[73476]:   </sysinfo>
Aug 26 20:42:03 user nova-compute[73476]:   <os>
Aug 26 20:42:03 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:42:03 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:42:03 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:42:03 user nova-compute[73476]:   </os>
Aug 26 20:42:03 user nova-compute[73476]:   <features>
Aug 26 20:42:03 user nova-compute[73476]:     <acpi/>
Aug 26 20:42:03 user nova-compute[73476]:     <apic/>
Aug 26 20:42:03 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:42:03 user nova-compute[73476]:   </features>
Aug 26 20:42:03 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:42:03 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:42:03 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:42:03 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:42:03 user nova-compute[73476]:   </clock>
Aug 26 20:42:03 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:42:03 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:42:03 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:42:03 user nova-compute[73476]:   </cpu>
Aug 26 20:42:03 user nova-compute[73476]:   <devices>
Aug 26 20:42:03 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:42:03 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:42:03 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk"/>
Aug 26 20:42:03 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:42:03 user nova-compute[73476]:     </disk>
Aug 26 20:42:03 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:42:03 user nova-compute[73476]:       <mac address="fa:16:3e:19:7f:fd"/>
Aug 26 20:42:03 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:42:03 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:42:03 user nova-compute[73476]:       <target dev="tap5378ea4f-5e"/>
Aug 26 20:42:03 user nova-compute[73476]:     </interface>
Aug 26 20:42:03 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:42:03 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/console.log" append="off"/>
Aug 26 20:42:03 user nova-compute[73476]:     </serial>
Aug 26 20:42:03 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:42:03 user nova-compute[73476]:     <video>
Aug 26 20:42:03 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:42:03 user nova-compute[73476]:     </video>
Aug 26 20:42:03 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:42:03 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:42:03 user nova-compute[73476]:     </rng>
Aug 26 20:42:03 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:42:03 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:42:03 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:42:03 user nova-compute[73476]:     </memballoon>
Aug 26 20:42:03 user nova-compute[73476]:   </devices>
Aug 26 20:42:03 user nova-compute[73476]: </domain>
Aug 26 20:42:03 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1272776851',display_name='tempest-VolumesAdminNegativeTest-server-1272776851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1272776851',id=7,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPd6S7mvw3TVXiOJ1xSq8JXRA05KgKlnD6kKubB6f+v8PlZc2rmU/hXdW8ntPBsNU7gSNc20+3JGqxYrI+O0kcs07XlKsU5IVPczin/QAeIUMTFwCzWo1i1ppjsPKrfxw==',key_name='tempest-keypair-182732187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0b92247b70b4ef6ab0d4bbb6a8a60f0',ramdisk_id='',reservation_id='r-ey2pn8ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1926983424',owner_user_name='tempest-VolumesAdminNegativeTest-1926983424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2bee4738d4442fabd6c6a802070555',uuid=22c72de3-e06b-4aae-bed9-162101a43e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converting VIF {"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:7f:fd,bridge_name='br-int',has_traffic_filtering=True,id=5378ea4f-5e56-4d66-a742-9b132fbc6160,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5378ea4f-5e') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG os_vif [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:7f:fd,bridge_name='br-int',has_traffic_filtering=True,id=5378ea4f-5e56-4d66-a742-9b132fbc6160,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5378ea4f-5e') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5378ea4f-5e, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5378ea4f-5e, col_values=(('external_ids', {'iface-id': '5378ea4f-5e56-4d66-a742-9b132fbc6160', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:7f:fd', 'vm-uuid': '22c72de3-e06b-4aae-bed9-162101a43e6f'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:03 user nova-compute[73476]: INFO os_vif [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:7f:fd,bridge_name='br-int',has_traffic_filtering=True,id=5378ea4f-5e56-4d66-a742-9b132fbc6160,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5378ea4f-5e')
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] No VIF found with MAC fa:16:3e:19:7f:fd, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:42:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-d75a7baa-4b7a-4e5d-8679-21247e6f344e req-4347c434-2873-4701-a179-2ae62a0a59a8 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Updated VIF entry in instance network info cache for port 5378ea4f-5e56-4d66-a742-9b132fbc6160. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:42:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-d75a7baa-4b7a-4e5d-8679-21247e6f344e req-4347c434-2873-4701-a179-2ae62a0a59a8 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Updating instance_info_cache with network_info: [{"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:42:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d75a7baa-4b7a-4e5d-8679-21247e6f344e req-4347c434-2873-4701-a179-2ae62a0a59a8 service nova] Releasing lock "refresh_cache-22c72de3-e06b-4aae-bed9-162101a43e6f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:42:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082529.4663074, 22c72de3-e06b-4aae-bed9-162101a43e6f => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:42:09 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] VM Resumed (Lifecycle Event)
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:42:09 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Instance spawned successfully.
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:09 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082529.4710214, 22c72de3-e06b-4aae-bed9-162101a43e6f => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:42:09 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] VM Started (Lifecycle Event)
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:42:09 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:42:09 user nova-compute[73476]: INFO nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Took 10.45 seconds to spawn the instance on the hypervisor.
Aug 26 20:42:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:09 user nova-compute[73476]: INFO nova.compute.manager [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Took 11.73 seconds to build instance.
Aug 26 20:42:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0c598fff-4c4b-4be1-9132-fb80945671f8 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-0221c86a-f68c-47dc-9b8d-8b41e00059e5 req-46b2554e-e422-48d6-b3d1-5bdf1ab7e137 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0221c86a-f68c-47dc-9b8d-8b41e00059e5 req-46b2554e-e422-48d6-b3d1-5bdf1ab7e137 service nova] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0221c86a-f68c-47dc-9b8d-8b41e00059e5 req-46b2554e-e422-48d6-b3d1-5bdf1ab7e137 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0221c86a-f68c-47dc-9b8d-8b41e00059e5 req-46b2554e-e422-48d6-b3d1-5bdf1ab7e137 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-0221c86a-f68c-47dc-9b8d-8b41e00059e5 req-46b2554e-e422-48d6-b3d1-5bdf1ab7e137 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] No waiting events found dispatching network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:13 user nova-compute[73476]: WARNING nova.compute.manager [req-0221c86a-f68c-47dc-9b8d-8b41e00059e5 req-46b2554e-e422-48d6-b3d1-5bdf1ab7e137 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received unexpected event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 for instance with vm_state active and task_state None.
Aug 26 20:42:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-5fd0774f-b4bd-471d-a8ac-5db1f0dfb47e req-d9f845e2-215f-47be-a610-51345e950d46 service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fd0774f-b4bd-471d-a8ac-5db1f0dfb47e req-d9f845e2-215f-47be-a610-51345e950d46 service nova] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fd0774f-b4bd-471d-a8ac-5db1f0dfb47e req-d9f845e2-215f-47be-a610-51345e950d46 service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fd0774f-b4bd-471d-a8ac-5db1f0dfb47e req-d9f845e2-215f-47be-a610-51345e950d46 service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-5fd0774f-b4bd-471d-a8ac-5db1f0dfb47e req-d9f845e2-215f-47be-a610-51345e950d46 service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] No waiting events found dispatching network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:14 user nova-compute[73476]: WARNING nova.compute.manager [req-5fd0774f-b4bd-471d-a8ac-5db1f0dfb47e req-d9f845e2-215f-47be-a610-51345e950d46 service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received unexpected event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad for instance with vm_state active and task_state None.
Aug 26 20:42:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:42:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-04f9eea6-ca77-4fa0-a135-929c5ac4ce3f req-5b86631c-d9b5-4fb6-8d35-1729d21f8f5b service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-04f9eea6-ca77-4fa0-a135-929c5ac4ce3f req-5b86631c-d9b5-4fb6-8d35-1729d21f8f5b service nova] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-04f9eea6-ca77-4fa0-a135-929c5ac4ce3f req-5b86631c-d9b5-4fb6-8d35-1729d21f8f5b service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-04f9eea6-ca77-4fa0-a135-929c5ac4ce3f req-5b86631c-d9b5-4fb6-8d35-1729d21f8f5b service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-04f9eea6-ca77-4fa0-a135-929c5ac4ce3f req-5b86631c-d9b5-4fb6-8d35-1729d21f8f5b service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] No waiting events found dispatching network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:15 user nova-compute[73476]: WARNING nova.compute.manager [req-04f9eea6-ca77-4fa0-a135-929c5ac4ce3f req-5b86631c-d9b5-4fb6-8d35-1729d21f8f5b service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received unexpected event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 for instance with vm_state active and task_state None.
Aug 26 20:42:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:42:15 user nova-compute[73476]: INFO nova.compute.claims [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Claim successful on node user
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.901s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] No waiting events found dispatching network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:16 user nova-compute[73476]: WARNING nova.compute.manager [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received unexpected event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad for instance with vm_state active and task_state None.
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:16 user nova-compute[73476]: WARNING nova.compute.manager [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state active and task_state None.
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:16 user nova-compute[73476]: WARNING nova.compute.manager [req-0ea04625-d64e-424d-9619-ca01ef2bd038 req-40e98914-38f2-4405-8e50-e622a1f5b29f service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state active and task_state None.
Aug 26 20:42:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:42:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG nova.policy [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e9f1517b4574f2dbe3def073c65a0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d347b5c87b440296fde039405de11d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:42:17 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Creating image(s)
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.243s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.231s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk 1073741824" returned: 0 in 0.066s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Cannot resize image /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Ensure instance console log exists: /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Successfully created port: dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:42:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Successfully updated port: dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquired lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-e39bd441-82b1-4fe1-990c-11dd0200c460 req-e715fb47-efa9-44aa-bd3d-fc75ca725552 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-changed-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-e39bd441-82b1-4fe1-990c-11dd0200c460 req-e715fb47-efa9-44aa-bd3d-fc75ca725552 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Refreshing instance network info cache due to event network-changed-dc8013cf-f972-4d70-a041-b91ace1b537d. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e39bd441-82b1-4fe1-990c-11dd0200c460 req-e715fb47-efa9-44aa-bd3d-fc75ca725552 service nova] Acquiring lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating instance_info_cache with network_info: [{"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Releasing lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Instance network_info: |[{"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e39bd441-82b1-4fe1-990c-11dd0200c460 req-e715fb47-efa9-44aa-bd3d-fc75ca725552 service nova] Acquired lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.network.neutron [req-e39bd441-82b1-4fe1-990c-11dd0200c460 req-e715fb47-efa9-44aa-bd3d-fc75ca725552 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Refreshing network info cache for port dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Start _get_guest_xml network_info=[{"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:42:19 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:19 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309021978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309021978',id=8,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv500ICYQkC8rlDl0rZ7fAGTJyj7kZ3tpS7wPZK0hi+dNo8U4bebGF/MrGe9anTbwaWZhwe37G7Y+gRDfa2LkkTJlaTK44hxXQMKLQOS5XgexamGee3hm5aT5V94z3v7Q==',key_name='tempest-keypair-1352386032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59d347b5c87b440296fde039405de11d',ramdisk_id='',reservation_id='r-i0hj5l0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-687865165',owner_user_name='tempest-TaggedAttachmentsTest-687865165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e9f1517b4574f2dbe3def073c65a0c7',uuid=8150e248-6046-4d1e-bb7c-3b94cd6d30e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converting VIF {"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=dc8013cf-f972-4d70-a041-b91ace1b537d,network=Network(632776c0-e757-4743-b525-fcf9b0a11560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8013cf-f9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.objects.instance [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lazy-loading 'pci_devices' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:42:19 user nova-compute[73476]:   <uuid>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</uuid>
Aug 26 20:42:19 user nova-compute[73476]:   <name>instance-00000008</name>
Aug 26 20:42:19 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:42:19 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:42:19 user nova-compute[73476]:   <metadata>
Aug 26 20:42:19 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:42:19 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:42:19 user nova-compute[73476]:       <nova:name>tempest-device-tagging-server-1309021978</nova:name>
Aug 26 20:42:19 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:42:19</nova:creationTime>
Aug 26 20:42:19 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:42:19 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:42:19 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:42:19 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:42:19 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:42:19 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:42:19 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:42:19 user nova-compute[73476]:       <nova:owner>
Aug 26 20:42:19 user nova-compute[73476]:         <nova:user uuid="0e9f1517b4574f2dbe3def073c65a0c7">tempest-TaggedAttachmentsTest-687865165-project-member</nova:user>
Aug 26 20:42:19 user nova-compute[73476]:         <nova:project uuid="59d347b5c87b440296fde039405de11d">tempest-TaggedAttachmentsTest-687865165</nova:project>
Aug 26 20:42:19 user nova-compute[73476]:       </nova:owner>
Aug 26 20:42:19 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:42:19 user nova-compute[73476]:       <nova:ports>
Aug 26 20:42:19 user nova-compute[73476]:         <nova:port uuid="dc8013cf-f972-4d70-a041-b91ace1b537d">
Aug 26 20:42:19 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:42:19 user nova-compute[73476]:         </nova:port>
Aug 26 20:42:19 user nova-compute[73476]:       </nova:ports>
Aug 26 20:42:19 user nova-compute[73476]:     </nova:instance>
Aug 26 20:42:19 user nova-compute[73476]:   </metadata>
Aug 26 20:42:19 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:42:19 user nova-compute[73476]:     <system>
Aug 26 20:42:19 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:42:19 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:42:19 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:42:19 user nova-compute[73476]:       <entry name="serial">8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:42:19 user nova-compute[73476]:       <entry name="uuid">8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:42:19 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:42:19 user nova-compute[73476]:     </system>
Aug 26 20:42:19 user nova-compute[73476]:   </sysinfo>
Aug 26 20:42:19 user nova-compute[73476]:   <os>
Aug 26 20:42:19 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:42:19 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:42:19 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:42:19 user nova-compute[73476]:   </os>
Aug 26 20:42:19 user nova-compute[73476]:   <features>
Aug 26 20:42:19 user nova-compute[73476]:     <acpi/>
Aug 26 20:42:19 user nova-compute[73476]:     <apic/>
Aug 26 20:42:19 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:42:19 user nova-compute[73476]:   </features>
Aug 26 20:42:19 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:42:19 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:42:19 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:42:19 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:42:19 user nova-compute[73476]:   </clock>
Aug 26 20:42:19 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:42:19 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:42:19 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:42:19 user nova-compute[73476]:   </cpu>
Aug 26 20:42:19 user nova-compute[73476]:   <devices>
Aug 26 20:42:19 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:42:19 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:42:19 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk"/>
Aug 26 20:42:19 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:42:19 user nova-compute[73476]:     </disk>
Aug 26 20:42:19 user nova-compute[73476]:     <disk type="file" device="cdrom">
Aug 26 20:42:19 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 20:42:19 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.config"/>
Aug 26 20:42:19 user nova-compute[73476]:       <target dev="hda" bus="ide"/>
Aug 26 20:42:19 user nova-compute[73476]:     </disk>
Aug 26 20:42:19 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:42:19 user nova-compute[73476]:       <mac address="fa:16:3e:e8:92:f2"/>
Aug 26 20:42:19 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:42:19 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:42:19 user nova-compute[73476]:       <target dev="tapdc8013cf-f9"/>
Aug 26 20:42:19 user nova-compute[73476]:     </interface>
Aug 26 20:42:19 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:42:19 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log" append="off"/>
Aug 26 20:42:19 user nova-compute[73476]:     </serial>
Aug 26 20:42:19 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:42:19 user nova-compute[73476]:     <video>
Aug 26 20:42:19 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:42:19 user nova-compute[73476]:     </video>
Aug 26 20:42:19 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:42:19 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:42:19 user nova-compute[73476]:     </rng>
Aug 26 20:42:19 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:42:19 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:42:19 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:42:19 user nova-compute[73476]:     </memballoon>
Aug 26 20:42:19 user nova-compute[73476]:   </devices>
Aug 26 20:42:19 user nova-compute[73476]: </domain>
Aug 26 20:42:19 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309021978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309021978',id=8,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv500ICYQkC8rlDl0rZ7fAGTJyj7kZ3tpS7wPZK0hi+dNo8U4bebGF/MrGe9anTbwaWZhwe37G7Y+gRDfa2LkkTJlaTK44hxXQMKLQOS5XgexamGee3hm5aT5V94z3v7Q==',key_name='tempest-keypair-1352386032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59d347b5c87b440296fde039405de11d',ramdisk_id='',reservation_id='r-i0hj5l0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-687865165',owner_user_name='tempest-TaggedAttachmentsTest-687865165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e9f1517b4574f2dbe3def073c65a0c7',uuid=8150e248-6046-4d1e-bb7c-3b94cd6d30e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converting VIF {"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=dc8013cf-f972-4d70-a041-b91ace1b537d,network=Network(632776c0-e757-4743-b525-fcf9b0a11560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8013cf-f9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG os_vif [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=dc8013cf-f972-4d70-a041-b91ace1b537d,network=Network(632776c0-e757-4743-b525-fcf9b0a11560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8013cf-f9') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] There are 0 instances to clean {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73476) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc8013cf-f9, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc8013cf-f9, col_values=(('external_ids', {'iface-id': 'dc8013cf-f972-4d70-a041-b91ace1b537d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:92:f2', 'vm-uuid': '8150e248-6046-4d1e-bb7c-3b94cd6d30e5'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:19 user nova-compute[73476]: INFO os_vif [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=dc8013cf-f972-4d70-a041-b91ace1b537d,network=Network(632776c0-e757-4743-b525-fcf9b0a11560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8013cf-f9')
Aug 26 20:42:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] No BDM found with device name hda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:42:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] No VIF found with MAC fa:16:3e:e8:92:f2, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:42:19 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Using config drive
Aug 26 20:42:20 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Creating config drive at /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.config
Aug 26 20:42:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjsf9pnd0 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjsf9pnd0" returned: 0 in 0.069s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG nova.network.neutron [req-e39bd441-82b1-4fe1-990c-11dd0200c460 req-e715fb47-efa9-44aa-bd3d-fc75ca725552 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updated VIF entry in instance network info cache for port dc8013cf-f972-4d70-a041-b91ace1b537d. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG nova.network.neutron [req-e39bd441-82b1-4fe1-990c-11dd0200c460 req-e715fb47-efa9-44aa-bd3d-fc75ca725552 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating instance_info_cache with network_info: [{"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e39bd441-82b1-4fe1-990c-11dd0200c460 req-e715fb47-efa9-44aa-bd3d-fc75ca725552 service nova] Releasing lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:42:20 user nova-compute[73476]: INFO nova.compute.claims [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Claim successful on node user
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:42:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.policy [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2cfbf9be26f48aa83e1afc8c120ebe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f12645467c4b44929f8d7006bfdb03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:42:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Creating image(s)
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "/opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "/opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.215s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.225s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk 1073741824" returned: 0 in 0.054s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-3f88d658-2024-467c-bc12-42f4d7a1faae req-8d2b434f-d016-4ee6-81e2-e119d219de56 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-plugged-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3f88d658-2024-467c-bc12-42f4d7a1faae req-8d2b434f-d016-4ee6-81e2-e119d219de56 service nova] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3f88d658-2024-467c-bc12-42f4d7a1faae req-8d2b434f-d016-4ee6-81e2-e119d219de56 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3f88d658-2024-467c-bc12-42f4d7a1faae req-8d2b434f-d016-4ee6-81e2-e119d219de56 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-3f88d658-2024-467c-bc12-42f4d7a1faae req-8d2b434f-d016-4ee6-81e2-e119d219de56 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] No waiting events found dispatching network-vif-plugged-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:22 user nova-compute[73476]: WARNING nova.compute.manager [req-3f88d658-2024-467c-bc12-42f4d7a1faae req-8d2b434f-d016-4ee6-81e2-e119d219de56 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received unexpected event network-vif-plugged-dc8013cf-f972-4d70-a041-b91ace1b537d for instance with vm_state building and task_state spawning.
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.302s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Successfully created port: bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:42:22 user nova-compute[73476]: INFO nova.compute.claims [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Claim successful on node user
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Cannot resize image /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Ensure instance console log exists: /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-f7d79b1b-d4fc-4863-85c2-84654e528fff req-7dd57071-e242-4ac6-9c55-fd3c673c2839 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f7d79b1b-d4fc-4863-85c2-84654e528fff req-7dd57071-e242-4ac6-9c55-fd3c673c2839 service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f7d79b1b-d4fc-4863-85c2-84654e528fff req-7dd57071-e242-4ac6-9c55-fd3c673c2839 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f7d79b1b-d4fc-4863-85c2-84654e528fff req-7dd57071-e242-4ac6-9c55-fd3c673c2839 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-f7d79b1b-d4fc-4863-85c2-84654e528fff req-7dd57071-e242-4ac6-9c55-fd3c673c2839 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:22 user nova-compute[73476]: WARNING nova.compute.manager [req-f7d79b1b-d4fc-4863-85c2-84654e528fff req-7dd57071-e242-4ac6-9c55-fd3c673c2839 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state None.
Aug 26 20:42:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:42:23 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:42:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:42:23 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Creating image(s)
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "/opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "/opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:23 user nova-compute[73476]: DEBUG nova.policy [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '741297cb47d6480381ad5522fd177412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d881ed25ae4e62a56d5da0c7edeab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.237s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk 1073741824" returned: 0 in 0.076s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.217s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-f052fdff-f451-44b4-b42f-46280fde12b5 req-11d33179-73ec-40fd-a404-cacfa8e78642 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-plugged-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f052fdff-f451-44b4-b42f-46280fde12b5 req-11d33179-73ec-40fd-a404-cacfa8e78642 service nova] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f052fdff-f451-44b4-b42f-46280fde12b5 req-11d33179-73ec-40fd-a404-cacfa8e78642 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f052fdff-f451-44b4-b42f-46280fde12b5 req-11d33179-73ec-40fd-a404-cacfa8e78642 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-f052fdff-f451-44b4-b42f-46280fde12b5 req-11d33179-73ec-40fd-a404-cacfa8e78642 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] No waiting events found dispatching network-vif-plugged-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:24 user nova-compute[73476]: WARNING nova.compute.manager [req-f052fdff-f451-44b4-b42f-46280fde12b5 req-11d33179-73ec-40fd-a404-cacfa8e78642 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received unexpected event network-vif-plugged-dc8013cf-f972-4d70-a041-b91ace1b537d for instance with vm_state building and task_state spawning.
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Cannot resize image /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Ensure instance console log exists: /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Successfully updated port: bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "refresh_cache-e9309346-2675-4bfd-9781-175b9b40d71e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquired lock "refresh_cache-e9309346-2675-4bfd-9781-175b9b40d71e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082544.631298, 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:42:24 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] VM Resumed (Lifecycle Event)
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:24 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Instance spawned successfully.
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:42:24 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082544.6416776, 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:42:24 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] VM Started (Lifecycle Event)
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:42:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:24 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:42:24 user nova-compute[73476]: INFO nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Took 7.58 seconds to spawn the instance on the hypervisor.
Aug 26 20:42:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:24 user nova-compute[73476]: INFO nova.compute.manager [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Took 9.34 seconds to build instance.
Aug 26 20:42:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f9c-6cd6-42f6-a594-a21fb6470685 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.529s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:25 user nova-compute[73476]: WARNING nova.compute.manager [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state None.
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received event network-changed-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Refreshing instance network info cache due to event network-changed-bb78e89a-f134-42de-bf9f-65454e85a33f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] Acquiring lock "refresh_cache-e9309346-2675-4bfd-9781-175b9b40d71e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Updating instance_info_cache with network_info: [{"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Releasing lock "refresh_cache-e9309346-2675-4bfd-9781-175b9b40d71e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Instance network_info: |[{"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] Acquired lock "refresh_cache-e9309346-2675-4bfd-9781-175b9b40d71e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.network.neutron [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Refreshing network info cache for port bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Start _get_guest_xml network_info=[{"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:42:25 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:25 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1316340121',display_name='tempest-TestVolumeSwap-server-1316340121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1316340121',id=9,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEN3qGYMgIlNUhRrgpbAcY/WhDf6cGpleVK3QszXdXnO3FyKDzkm8b4G9NysMyNkg3QUTjEXpUSCWGhGnosJDw5gDbGiMj3FMllYWd8UCm0pIHUg7y3IGW0HzBVztelBw==',key_name='tempest-keypair-1302543546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42f12645467c4b44929f8d7006bfdb03',ramdisk_id='',reservation_id='r-rdx6rjjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-11679679',owner_user_name='tempest-TestVolumeSwap-11679679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2cfbf9be26f48aa83e1afc8c120ebe7',uuid=e9309346-2675-4bfd-9781-175b9b40d71e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Converting VIF {"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:8e:85,bridge_name='br-int',has_traffic_filtering=True,id=bb78e89a-f134-42de-bf9f-65454e85a33f,network=Network(5aa93d97-2a1e-4de7-b8b4-e60624c588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb78e89a-f1') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lazy-loading 'pci_devices' on Instance uuid e9309346-2675-4bfd-9781-175b9b40d71e {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Successfully created port: 4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:42:25 user nova-compute[73476]:   <uuid>e9309346-2675-4bfd-9781-175b9b40d71e</uuid>
Aug 26 20:42:25 user nova-compute[73476]:   <name>instance-00000009</name>
Aug 26 20:42:25 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:42:25 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:42:25 user nova-compute[73476]:   <metadata>
Aug 26 20:42:25 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:42:25 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:42:25 user nova-compute[73476]:       <nova:name>tempest-TestVolumeSwap-server-1316340121</nova:name>
Aug 26 20:42:25 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:42:25</nova:creationTime>
Aug 26 20:42:25 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:42:25 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:42:25 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:42:25 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:42:25 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:42:25 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:42:25 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:42:25 user nova-compute[73476]:       <nova:owner>
Aug 26 20:42:25 user nova-compute[73476]:         <nova:user uuid="b2cfbf9be26f48aa83e1afc8c120ebe7">tempest-TestVolumeSwap-11679679-project-member</nova:user>
Aug 26 20:42:25 user nova-compute[73476]:         <nova:project uuid="42f12645467c4b44929f8d7006bfdb03">tempest-TestVolumeSwap-11679679</nova:project>
Aug 26 20:42:25 user nova-compute[73476]:       </nova:owner>
Aug 26 20:42:25 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:42:25 user nova-compute[73476]:       <nova:ports>
Aug 26 20:42:25 user nova-compute[73476]:         <nova:port uuid="bb78e89a-f134-42de-bf9f-65454e85a33f">
Aug 26 20:42:25 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 20:42:25 user nova-compute[73476]:         </nova:port>
Aug 26 20:42:25 user nova-compute[73476]:       </nova:ports>
Aug 26 20:42:25 user nova-compute[73476]:     </nova:instance>
Aug 26 20:42:25 user nova-compute[73476]:   </metadata>
Aug 26 20:42:25 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:42:25 user nova-compute[73476]:     <system>
Aug 26 20:42:25 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:42:25 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:42:25 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:42:25 user nova-compute[73476]:       <entry name="serial">e9309346-2675-4bfd-9781-175b9b40d71e</entry>
Aug 26 20:42:25 user nova-compute[73476]:       <entry name="uuid">e9309346-2675-4bfd-9781-175b9b40d71e</entry>
Aug 26 20:42:25 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:42:25 user nova-compute[73476]:     </system>
Aug 26 20:42:25 user nova-compute[73476]:   </sysinfo>
Aug 26 20:42:25 user nova-compute[73476]:   <os>
Aug 26 20:42:25 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:42:25 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:42:25 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:42:25 user nova-compute[73476]:   </os>
Aug 26 20:42:25 user nova-compute[73476]:   <features>
Aug 26 20:42:25 user nova-compute[73476]:     <acpi/>
Aug 26 20:42:25 user nova-compute[73476]:     <apic/>
Aug 26 20:42:25 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:42:25 user nova-compute[73476]:   </features>
Aug 26 20:42:25 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:42:25 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:42:25 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:42:25 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:42:25 user nova-compute[73476]:   </clock>
Aug 26 20:42:25 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:42:25 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:42:25 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:42:25 user nova-compute[73476]:   </cpu>
Aug 26 20:42:25 user nova-compute[73476]:   <devices>
Aug 26 20:42:25 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:42:25 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:42:25 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk"/>
Aug 26 20:42:25 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:42:25 user nova-compute[73476]:     </disk>
Aug 26 20:42:25 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:42:25 user nova-compute[73476]:       <mac address="fa:16:3e:00:8e:85"/>
Aug 26 20:42:25 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:42:25 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:42:25 user nova-compute[73476]:       <target dev="tapbb78e89a-f1"/>
Aug 26 20:42:25 user nova-compute[73476]:     </interface>
Aug 26 20:42:25 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:42:25 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/console.log" append="off"/>
Aug 26 20:42:25 user nova-compute[73476]:     </serial>
Aug 26 20:42:25 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:42:25 user nova-compute[73476]:     <video>
Aug 26 20:42:25 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:42:25 user nova-compute[73476]:     </video>
Aug 26 20:42:25 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:42:25 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:42:25 user nova-compute[73476]:     </rng>
Aug 26 20:42:25 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:42:25 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:42:25 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:42:25 user nova-compute[73476]:     </memballoon>
Aug 26 20:42:25 user nova-compute[73476]:   </devices>
Aug 26 20:42:25 user nova-compute[73476]: </domain>
Aug 26 20:42:25 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1316340121',display_name='tempest-TestVolumeSwap-server-1316340121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1316340121',id=9,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEN3qGYMgIlNUhRrgpbAcY/WhDf6cGpleVK3QszXdXnO3FyKDzkm8b4G9NysMyNkg3QUTjEXpUSCWGhGnosJDw5gDbGiMj3FMllYWd8UCm0pIHUg7y3IGW0HzBVztelBw==',key_name='tempest-keypair-1302543546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42f12645467c4b44929f8d7006bfdb03',ramdisk_id='',reservation_id='r-rdx6rjjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-11679679',owner_user_name='tempest-TestVolumeSwap-11679679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2cfbf9be26f48aa83e1afc8c120ebe7',uuid=e9309346-2675-4bfd-9781-175b9b40d71e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Converting VIF {"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:8e:85,bridge_name='br-int',has_traffic_filtering=True,id=bb78e89a-f134-42de-bf9f-65454e85a33f,network=Network(5aa93d97-2a1e-4de7-b8b4-e60624c588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb78e89a-f1') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG os_vif [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:8e:85,bridge_name='br-int',has_traffic_filtering=True,id=bb78e89a-f134-42de-bf9f-65454e85a33f,network=Network(5aa93d97-2a1e-4de7-b8b4-e60624c588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb78e89a-f1') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb78e89a-f1, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb78e89a-f1, col_values=(('external_ids', {'iface-id': 'bb78e89a-f134-42de-bf9f-65454e85a33f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:8e:85', 'vm-uuid': 'e9309346-2675-4bfd-9781-175b9b40d71e'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:25 user nova-compute[73476]: INFO os_vif [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:8e:85,bridge_name='br-int',has_traffic_filtering=True,id=bb78e89a-f134-42de-bf9f-65454e85a33f,network=Network(5aa93d97-2a1e-4de7-b8b4-e60624c588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb78e89a-f1')
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] No VIF found with MAC fa:16:3e:00:8e:85, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:25 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:42:26 user nova-compute[73476]: DEBUG nova.network.neutron [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Updated VIF entry in instance network info cache for port bb78e89a-f134-42de-bf9f-65454e85a33f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:42:26 user nova-compute[73476]: DEBUG nova.network.neutron [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Updating instance_info_cache with network_info: [{"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:42:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1186e429-babc-4000-b645-d116d49ed4f1 req-c56fdbe9-32da-4d0e-a8ae-fd4b097cb679 service nova] Releasing lock "refresh_cache-e9309346-2675-4bfd-9781-175b9b40d71e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Successfully updated port: 4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquiring lock "refresh_cache-ee7cf32f-71c2-49ca-8a23-51fc95560974" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquired lock "refresh_cache-ee7cf32f-71c2-49ca-8a23-51fc95560974" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-ba271439-f4d2-465f-8dae-51075fd3feaf req-82ea9417-5238-4048-b0a4-da15623fb747 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received event network-changed-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-ba271439-f4d2-465f-8dae-51075fd3feaf req-82ea9417-5238-4048-b0a4-da15623fb747 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Refreshing instance network info cache due to event network-changed-4ebaad24-c622-4e30-813a-3566c5edaeca. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ba271439-f4d2-465f-8dae-51075fd3feaf req-82ea9417-5238-4048-b0a4-da15623fb747 service nova] Acquiring lock "refresh_cache-ee7cf32f-71c2-49ca-8a23-51fc95560974" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:42:27 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.network.neutron [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Updating instance_info_cache with network_info: [{"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Releasing lock "refresh_cache-ee7cf32f-71c2-49ca-8a23-51fc95560974" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Instance network_info: |[{"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ba271439-f4d2-465f-8dae-51075fd3feaf req-82ea9417-5238-4048-b0a4-da15623fb747 service nova] Acquired lock "refresh_cache-ee7cf32f-71c2-49ca-8a23-51fc95560974" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.network.neutron [req-ba271439-f4d2-465f-8dae-51075fd3feaf req-82ea9417-5238-4048-b0a4-da15623fb747 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Refreshing network info cache for port 4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Start _get_guest_xml network_info=[{"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:28 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:28 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1159189828',display_name='tempest-VolumesAssistedSnapshotsTest-server-1159189828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1159189828',id=10,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDUPXj1AzfuxIeAIXOrpyqOf8irHPw2suFNDl4usSO3Rg4jYxe+UpJDqioZSRsORZFn9JGZ86v086OFvmjxXXReyupJ5DSE60kvoVSEu10g1R4O5jijqqGO56AgRabE7w==',key_name='tempest-keypair-858740917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d881ed25ae4e62a56d5da0c7edeab3',ramdisk_id='',reservation_id='r-g3r5kzyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1739682517',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1739682517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741297cb47d6480381ad5522fd177412',uuid=ee7cf32f-71c2-49ca-8a23-51fc95560974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Converting VIF {"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:98:32,bridge_name='br-int',has_traffic_filtering=True,id=4ebaad24-c622-4e30-813a-3566c5edaeca,network=Network(5dae46ca-c114-483d-ba07-c88a483182d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebaad24-c6') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.objects.instance [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lazy-loading 'pci_devices' on Instance uuid ee7cf32f-71c2-49ca-8a23-51fc95560974 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:42:28 user nova-compute[73476]:   <uuid>ee7cf32f-71c2-49ca-8a23-51fc95560974</uuid>
Aug 26 20:42:28 user nova-compute[73476]:   <name>instance-0000000a</name>
Aug 26 20:42:28 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:42:28 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:42:28 user nova-compute[73476]:   <metadata>
Aug 26 20:42:28 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:42:28 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:42:28 user nova-compute[73476]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1159189828</nova:name>
Aug 26 20:42:28 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:42:28</nova:creationTime>
Aug 26 20:42:28 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:42:28 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:42:28 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:42:28 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:42:28 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:42:28 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:42:28 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:42:28 user nova-compute[73476]:       <nova:owner>
Aug 26 20:42:28 user nova-compute[73476]:         <nova:user uuid="741297cb47d6480381ad5522fd177412">tempest-VolumesAssistedSnapshotsTest-1739682517-project-member</nova:user>
Aug 26 20:42:28 user nova-compute[73476]:         <nova:project uuid="f5d881ed25ae4e62a56d5da0c7edeab3">tempest-VolumesAssistedSnapshotsTest-1739682517</nova:project>
Aug 26 20:42:28 user nova-compute[73476]:       </nova:owner>
Aug 26 20:42:28 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:42:28 user nova-compute[73476]:       <nova:ports>
Aug 26 20:42:28 user nova-compute[73476]:         <nova:port uuid="4ebaad24-c622-4e30-813a-3566c5edaeca">
Aug 26 20:42:28 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 20:42:28 user nova-compute[73476]:         </nova:port>
Aug 26 20:42:28 user nova-compute[73476]:       </nova:ports>
Aug 26 20:42:28 user nova-compute[73476]:     </nova:instance>
Aug 26 20:42:28 user nova-compute[73476]:   </metadata>
Aug 26 20:42:28 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:42:28 user nova-compute[73476]:     <system>
Aug 26 20:42:28 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:42:28 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:42:28 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:42:28 user nova-compute[73476]:       <entry name="serial">ee7cf32f-71c2-49ca-8a23-51fc95560974</entry>
Aug 26 20:42:28 user nova-compute[73476]:       <entry name="uuid">ee7cf32f-71c2-49ca-8a23-51fc95560974</entry>
Aug 26 20:42:28 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:42:28 user nova-compute[73476]:     </system>
Aug 26 20:42:28 user nova-compute[73476]:   </sysinfo>
Aug 26 20:42:28 user nova-compute[73476]:   <os>
Aug 26 20:42:28 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:42:28 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:42:28 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:42:28 user nova-compute[73476]:   </os>
Aug 26 20:42:28 user nova-compute[73476]:   <features>
Aug 26 20:42:28 user nova-compute[73476]:     <acpi/>
Aug 26 20:42:28 user nova-compute[73476]:     <apic/>
Aug 26 20:42:28 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:42:28 user nova-compute[73476]:   </features>
Aug 26 20:42:28 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:42:28 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:42:28 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:42:28 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:42:28 user nova-compute[73476]:   </clock>
Aug 26 20:42:28 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:42:28 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:42:28 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:42:28 user nova-compute[73476]:   </cpu>
Aug 26 20:42:28 user nova-compute[73476]:   <devices>
Aug 26 20:42:28 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:42:28 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:42:28 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk"/>
Aug 26 20:42:28 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:42:28 user nova-compute[73476]:     </disk>
Aug 26 20:42:28 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:42:28 user nova-compute[73476]:       <mac address="fa:16:3e:e3:98:32"/>
Aug 26 20:42:28 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:42:28 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:42:28 user nova-compute[73476]:       <target dev="tap4ebaad24-c6"/>
Aug 26 20:42:28 user nova-compute[73476]:     </interface>
Aug 26 20:42:28 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:42:28 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/console.log" append="off"/>
Aug 26 20:42:28 user nova-compute[73476]:     </serial>
Aug 26 20:42:28 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:42:28 user nova-compute[73476]:     <video>
Aug 26 20:42:28 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:42:28 user nova-compute[73476]:     </video>
Aug 26 20:42:28 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:42:28 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:42:28 user nova-compute[73476]:     </rng>
Aug 26 20:42:28 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:42:28 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:42:28 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:42:28 user nova-compute[73476]:     </memballoon>
Aug 26 20:42:28 user nova-compute[73476]:   </devices>
Aug 26 20:42:28 user nova-compute[73476]: </domain>
Aug 26 20:42:28 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1159189828',display_name='tempest-VolumesAssistedSnapshotsTest-server-1159189828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1159189828',id=10,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDUPXj1AzfuxIeAIXOrpyqOf8irHPw2suFNDl4usSO3Rg4jYxe+UpJDqioZSRsORZFn9JGZ86v086OFvmjxXXReyupJ5DSE60kvoVSEu10g1R4O5jijqqGO56AgRabE7w==',key_name='tempest-keypair-858740917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d881ed25ae4e62a56d5da0c7edeab3',ramdisk_id='',reservation_id='r-g3r5kzyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1739682517',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1739682517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741297cb47d6480381ad5522fd177412',uuid=ee7cf32f-71c2-49ca-8a23-51fc95560974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Converting VIF {"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:98:32,bridge_name='br-int',has_traffic_filtering=True,id=4ebaad24-c622-4e30-813a-3566c5edaeca,network=Network(5dae46ca-c114-483d-ba07-c88a483182d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebaad24-c6') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG os_vif [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:98:32,bridge_name='br-int',has_traffic_filtering=True,id=4ebaad24-c622-4e30-813a-3566c5edaeca,network=Network(5dae46ca-c114-483d-ba07-c88a483182d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebaad24-c6') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ebaad24-c6, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ebaad24-c6, col_values=(('external_ids', {'iface-id': '4ebaad24-c622-4e30-813a-3566c5edaeca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:98:32', 'vm-uuid': 'ee7cf32f-71c2-49ca-8a23-51fc95560974'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:28 user nova-compute[73476]: INFO os_vif [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:98:32,bridge_name='br-int',has_traffic_filtering=True,id=4ebaad24-c622-4e30-813a-3566c5edaeca,network=Network(5dae46ca-c114-483d-ba07-c88a483182d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebaad24-c6')
Aug 26 20:42:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:42:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] No VIF found with MAC fa:16:3e:e3:98:32, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG nova.network.neutron [req-ba271439-f4d2-465f-8dae-51075fd3feaf req-82ea9417-5238-4048-b0a4-da15623fb747 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Updated VIF entry in instance network info cache for port 4ebaad24-c622-4e30-813a-3566c5edaeca. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG nova.network.neutron [req-ba271439-f4d2-465f-8dae-51075fd3feaf req-82ea9417-5238-4048-b0a4-da15623fb747 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Updating instance_info_cache with network_info: [{"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ba271439-f4d2-465f-8dae-51075fd3feaf req-82ea9417-5238-4048-b0a4-da15623fb747 service nova] Releasing lock "refresh_cache-ee7cf32f-71c2-49ca-8a23-51fc95560974" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082550.0386257, e9309346-2675-4bfd-9781-175b9b40d71e => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:42:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] VM Resumed (Lifecycle Event)
Aug 26 20:42:30 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Instance spawned successfully.
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:42:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082550.03897, e9309346-2675-4bfd-9781-175b9b40d71e => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:42:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] VM Started (Lifecycle Event)
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:30 user nova-compute[73476]: INFO nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Took 8.60 seconds to spawn the instance on the hypervisor.
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:42:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:30 user nova-compute[73476]: INFO nova.compute.manager [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Took 9.65 seconds to build instance.
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e3703ca-c9ac-4a28-825e-597205ca5af9 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.793s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json" returned: 0 in 0.348s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-3ebd6680-85a9-419c-afb8-b3ebdf16ee00 req-9a29052c-ea1b-4072-9df3-29ab92f8e681 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received event network-vif-plugged-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3ebd6680-85a9-419c-afb8-b3ebdf16ee00 req-9a29052c-ea1b-4072-9df3-29ab92f8e681 service nova] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3ebd6680-85a9-419c-afb8-b3ebdf16ee00 req-9a29052c-ea1b-4072-9df3-29ab92f8e681 service nova] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3ebd6680-85a9-419c-afb8-b3ebdf16ee00 req-9a29052c-ea1b-4072-9df3-29ab92f8e681 service nova] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-3ebd6680-85a9-419c-afb8-b3ebdf16ee00 req-9a29052c-ea1b-4072-9df3-29ab92f8e681 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] No waiting events found dispatching network-vif-plugged-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:30 user nova-compute[73476]: WARNING nova.compute.manager [req-3ebd6680-85a9-419c-afb8-b3ebdf16ee00 req-9a29052c-ea1b-4072-9df3-29ab92f8e681 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received unexpected event network-vif-plugged-4ebaad24-c622-4e30-813a-3566c5edaeca for instance with vm_state building and task_state spawning.
Aug 26 20:42:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:42:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-3de059b5-0add-41f8-8cdb-58edb9373d5c req-3a01254d-531b-4b83-b95b-9382f772b23f service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received event network-vif-plugged-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3de059b5-0add-41f8-8cdb-58edb9373d5c req-3a01254d-531b-4b83-b95b-9382f772b23f service nova] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3de059b5-0add-41f8-8cdb-58edb9373d5c req-3a01254d-531b-4b83-b95b-9382f772b23f service nova] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3de059b5-0add-41f8-8cdb-58edb9373d5c req-3a01254d-531b-4b83-b95b-9382f772b23f service nova] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-3de059b5-0add-41f8-8cdb-58edb9373d5c req-3a01254d-531b-4b83-b95b-9382f772b23f service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] No waiting events found dispatching network-vif-plugged-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:33 user nova-compute[73476]: WARNING nova.compute.manager [req-3de059b5-0add-41f8-8cdb-58edb9373d5c req-3a01254d-531b-4b83-b95b-9382f772b23f service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received unexpected event network-vif-plugged-4ebaad24-c622-4e30-813a-3566c5edaeca for instance with vm_state building and task_state spawning.
Aug 26 20:42:33 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:33 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=7355MB free_disk=25.73900604248047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082553.3125114, ee7cf32f-71c2-49ca-8a23-51fc95560974 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:42:33 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] VM Resumed (Lifecycle Event)
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:42:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Instance spawned successfully.
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:42:33 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082553.3173926, ee7cf32f-71c2-49ca-8a23-51fc95560974 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:42:33 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] VM Started (Lifecycle Event)
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:42:33 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:42:33 user nova-compute[73476]: INFO nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Took 9.90 seconds to spawn the instance on the hypervisor.
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e2e5572a-5c09-4217-a5db-c05ebf3227e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ad42cf47-42fb-488f-a44f-cf9824dd4d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22c72de3-e06b-4aae-bed9-162101a43e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e9309346-2675-4bfd-9781-175b9b40d71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ee7cf32f-71c2-49ca-8a23-51fc95560974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing inventories for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating ProviderTree inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 20:42:33 user nova-compute[73476]: INFO nova.compute.manager [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Took 10.94 seconds to build instance.
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing aggregate associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, aggregates: None {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ec5177fb-36b0-42ba-8a4b-5ceb4ac3a838 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.176s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing trait associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:34 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:42:34 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:42:34 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:42:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.104s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 22b50300-8865-4854-b0c7-ed63ca60c85b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG nova.compute.manager [req-349a5a2a-33bb-4534-ab30-5103d6c20dd0 req-29287f5b-6e45-4594-9512-94c3c38fbd96 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received event network-vif-plugged-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-349a5a2a-33bb-4534-ab30-5103d6c20dd0 req-29287f5b-6e45-4594-9512-94c3c38fbd96 service nova] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-349a5a2a-33bb-4534-ab30-5103d6c20dd0 req-29287f5b-6e45-4594-9512-94c3c38fbd96 service nova] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-349a5a2a-33bb-4534-ab30-5103d6c20dd0 req-29287f5b-6e45-4594-9512-94c3c38fbd96 service nova] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:36 user nova-compute[73476]: DEBUG nova.compute.manager [req-349a5a2a-33bb-4534-ab30-5103d6c20dd0 req-29287f5b-6e45-4594-9512-94c3c38fbd96 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] No waiting events found dispatching network-vif-plugged-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:36 user nova-compute[73476]: WARNING nova.compute.manager [req-349a5a2a-33bb-4534-ab30-5103d6c20dd0 req-29287f5b-6e45-4594-9512-94c3c38fbd96 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received unexpected event network-vif-plugged-bb78e89a-f134-42de-bf9f-65454e85a33f for instance with vm_state active and task_state None.
Aug 26 20:42:37 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updating instance_info_cache with network_info: [{"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:42:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:42:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:42:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c8a617b-478b-4f13-971d-8b0037e61c06 req-fbdb998e-499b-4872-b062-2e9c83552417 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received event network-vif-plugged-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:42:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c8a617b-478b-4f13-971d-8b0037e61c06 req-fbdb998e-499b-4872-b062-2e9c83552417 service nova] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:42:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c8a617b-478b-4f13-971d-8b0037e61c06 req-fbdb998e-499b-4872-b062-2e9c83552417 service nova] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:42:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c8a617b-478b-4f13-971d-8b0037e61c06 req-fbdb998e-499b-4872-b062-2e9c83552417 service nova] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:42:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c8a617b-478b-4f13-971d-8b0037e61c06 req-fbdb998e-499b-4872-b062-2e9c83552417 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] No waiting events found dispatching network-vif-plugged-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:42:38 user nova-compute[73476]: WARNING nova.compute.manager [req-3c8a617b-478b-4f13-971d-8b0037e61c06 req-fbdb998e-499b-4872-b062-2e9c83552417 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received unexpected event network-vif-plugged-bb78e89a-f134-42de-bf9f-65454e85a33f for instance with vm_state active and task_state None.
Aug 26 20:42:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:42:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:43:00 user nova-compute[73476]: INFO nova.compute.claims [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Claim successful on node user
Aug 26 20:43:00 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:43:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:43:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:43:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:43:00 user nova-compute[73476]: INFO nova.virt.block_device [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Booting with volume fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 at /dev/vda
Aug 26 20:43:01 user nova-compute[73476]: DEBUG nova.policy [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea7080831dda481c8f964e501e6037c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee51467d38d14f2d94d0a172d75d03bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:43:01 user nova-compute[73476]: DEBUG os_brick.utils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:01 user nova-compute[73476]: INFO oslo.privsep.daemon [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp8q0qnift/privsep.sock']
Aug 26 20:43:01 user sudo[84817]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp8q0qnift/privsep.sock
Aug 26 20:43:01 user sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 20:43:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully created port: a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:43:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully created port: 63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:43:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully created port: 4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:43:02 user sudo[84817]: pam_unix(sudo:session): session closed for user root
Aug 26 20:43:02 user nova-compute[73476]: INFO oslo.privsep.daemon [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Spawned new privsep daemon via rootwrap
Aug 26 20:43:02 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 20:43:02 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 20:43:02 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 20:43:02 user nova-compute[73476]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84820
Aug 26 20:43:02 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd4a34f-fbba-48cd-a1ae-69fc87391faa]: (2,) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:02 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc7baab-0d2e-421e-9c69-567cf2c3f182]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:02 user nova-compute[73476]: WARNING os_brick.initiator.connectors.nvmeof [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 20:43:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:02 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8786b51-bc24-405c-941b-935c1d27cbe8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f76d83b-bd81-4d26-9556-5f6cb0593ed0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7464a4b4-e78c-4d5e-90fb-9121ff174669]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:03 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:43:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec062b-39cb-4212-b852-7d6c29617232]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG os_brick.utils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] <== get_connector_properties: return (2033ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating existing volume attachment record: 2de68e18-1ee5-4a5c-bb33-15923280b842 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully created port: 2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:04 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully created port: 0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:43:05 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully updated port: a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:43:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-27052260-2eb4-45e6-9762-e49d639439f4 req-58ac5808-715e-4535-a619-b56b0953a8f0 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-changed-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-27052260-2eb4-45e6-9762-e49d639439f4 req-58ac5808-715e-4535-a619-b56b0953a8f0 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing instance network info cache due to event network-changed-a1a7a9b5-7aa3-42d6-ab15-63bc93963079. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-27052260-2eb4-45e6-9762-e49d639439f4 req-58ac5808-715e-4535-a619-b56b0953a8f0 service nova] Acquiring lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-27052260-2eb4-45e6-9762-e49d639439f4 req-58ac5808-715e-4535-a619-b56b0953a8f0 service nova] Acquired lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:05 user nova-compute[73476]: DEBUG nova.network.neutron [req-27052260-2eb4-45e6-9762-e49d639439f4 req-58ac5808-715e-4535-a619-b56b0953a8f0 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing network info cache for port a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:05 user nova-compute[73476]: DEBUG nova.network.neutron [req-27052260-2eb4-45e6-9762-e49d639439f4 req-58ac5808-715e-4535-a619-b56b0953a8f0 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:43:06 user nova-compute[73476]: DEBUG nova.network.neutron [req-27052260-2eb4-45e6-9762-e49d639439f4 req-58ac5808-715e-4535-a619-b56b0953a8f0 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-27052260-2eb4-45e6-9762-e49d639439f4 req-58ac5808-715e-4535-a619-b56b0953a8f0 service nova] Releasing lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:06 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully updated port: f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:43:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-a9f248b2-eb5d-4d6d-ac98-d821dc6c3735 req-e236004a-7d01-499a-9c13-192e1af45cce service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-changed-f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-a9f248b2-eb5d-4d6d-ac98-d821dc6c3735 req-e236004a-7d01-499a-9c13-192e1af45cce service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing instance network info cache due to event network-changed-f52cf477-0f53-45ee-81ec-9c167df18045. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a9f248b2-eb5d-4d6d-ac98-d821dc6c3735 req-e236004a-7d01-499a-9c13-192e1af45cce service nova] Acquiring lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a9f248b2-eb5d-4d6d-ac98-d821dc6c3735 req-e236004a-7d01-499a-9c13-192e1af45cce service nova] Acquired lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-a9f248b2-eb5d-4d6d-ac98-d821dc6c3735 req-e236004a-7d01-499a-9c13-192e1af45cce service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing network info cache for port f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:07 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully updated port: 39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:43:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-a9f248b2-eb5d-4d6d-ac98-d821dc6c3735 req-e236004a-7d01-499a-9c13-192e1af45cce service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:43:08 user nova-compute[73476]: DEBUG nova.network.neutron [req-a9f248b2-eb5d-4d6d-ac98-d821dc6c3735 req-e236004a-7d01-499a-9c13-192e1af45cce service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a9f248b2-eb5d-4d6d-ac98-d821dc6c3735 req-e236004a-7d01-499a-9c13-192e1af45cce service nova] Releasing lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:08 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully updated port: 63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:43:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:09 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully updated port: 4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:43:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-changed-39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing instance network info cache due to event network-changed-39bca6ec-db93-4751-aae8-459cb1493eff. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] Acquiring lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] Acquired lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:09 user nova-compute[73476]: DEBUG nova.network.neutron [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing network info cache for port 39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:09 user nova-compute[73476]: DEBUG nova.network.neutron [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:43:10 user nova-compute[73476]: DEBUG nova.network.neutron [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] Releasing lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-changed-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing instance network info cache due to event network-changed-63514087-bf1a-4562-bc47-5d4f2ee425e6. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] Acquiring lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] Acquired lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:10 user nova-compute[73476]: DEBUG nova.network.neutron [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing network info cache for port 63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:10 user nova-compute[73476]: DEBUG nova.network.neutron [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG nova.network.neutron [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] Releasing lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-changed-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing instance network info cache due to event network-changed-4894df4f-d1e9-4349-9669-0e21ac0d13fd. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] Acquiring lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] Acquired lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG nova.network.neutron [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing network info cache for port 4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully updated port: 2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG nova.network.neutron [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG nova.network.neutron [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a513b3cc-d253-4075-9bbd-fc44c5603b07 req-cafa5b26-ca07-4a45-9163-dfc1ff0bdf09 service nova] Releasing lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-0a2f35e1-bd75-4545-b1f6-012b7c65efa5 req-d61e0701-2671-492e-a81b-0da1d8779390 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-changed-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-0a2f35e1-bd75-4545-b1f6-012b7c65efa5 req-d61e0701-2671-492e-a81b-0da1d8779390 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing instance network info cache due to event network-changed-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0a2f35e1-bd75-4545-b1f6-012b7c65efa5 req-d61e0701-2671-492e-a81b-0da1d8779390 service nova] Acquiring lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0a2f35e1-bd75-4545-b1f6-012b7c65efa5 req-d61e0701-2671-492e-a81b-0da1d8779390 service nova] Acquired lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG nova.network.neutron [req-0a2f35e1-bd75-4545-b1f6-012b7c65efa5 req-d61e0701-2671-492e-a81b-0da1d8779390 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing network info cache for port 2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG nova.network.neutron [req-0a2f35e1-bd75-4545-b1f6-012b7c65efa5 req-d61e0701-2671-492e-a81b-0da1d8779390 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Successfully updated port: 0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG nova.network.neutron [req-0a2f35e1-bd75-4545-b1f6-012b7c65efa5 req-d61e0701-2671-492e-a81b-0da1d8779390 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0a2f35e1-bd75-4545-b1f6-012b7c65efa5 req-d61e0701-2671-492e-a81b-0da1d8779390 service nova] Releasing lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquired lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:43:12 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:43:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 20:43:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:43:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:43:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f335d273-096c-46a3-81d6-d30ea1be731e req-d5fea41c-e2d8-41dc-906e-52344c31b810 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-changed-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f335d273-096c-46a3-81d6-d30ea1be731e req-d5fea41c-e2d8-41dc-906e-52344c31b810 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing instance network info cache due to event network-changed-0d363dad-ebd2-4894-ba7c-586441bb567f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f335d273-096c-46a3-81d6-d30ea1be731e req-d5fea41c-e2d8-41dc-906e-52344c31b810 service nova] Acquiring lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:14 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [{"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Releasing lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance network_info: |[{"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:43:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f335d273-096c-46a3-81d6-d30ea1be731e req-d5fea41c-e2d8-41dc-906e-52344c31b810 service nova] Acquired lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:14 user nova-compute[73476]: DEBUG nova.network.neutron [req-f335d273-096c-46a3-81d6-d30ea1be731e req-d5fea41c-e2d8-41dc-906e-52344c31b810 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing network info cache for port 0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG nova.network.neutron [req-f335d273-096c-46a3-81d6-d30ea1be731e req-d5fea41c-e2d8-41dc-906e-52344c31b810 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updated VIF entry in instance network info cache for port 0d363dad-ebd2-4894-ba7c-586441bb567f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG nova.network.neutron [req-f335d273-096c-46a3-81d6-d30ea1be731e req-d5fea41c-e2d8-41dc-906e-52344c31b810 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [{"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f335d273-096c-46a3-81d6-d30ea1be731e req-d5fea41c-e2d8-41dc-906e-52344c31b810 service nova] Releasing lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:15 user nova-compute[73476]: INFO nova.virt.block_device [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Booting with volume f72e6e2a-f102-4cb0-9816-192f6763bf1d at /dev/vdb
Aug 26 20:43:15 user nova-compute[73476]: DEBUG os_brick.utils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a94c353-8f87-401c-b29c-a155694141f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03e14bc-463f-4743-97d8-4ffc5758ba18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99210de-a8a1-4f84-890c-ac2b1be501a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cf4ce0-5697-4b27-b165-0b0ab1c16243]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:15 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:43:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a1a255-7798-4c0f-a9ea-f4eb9d3d3d7a]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG os_brick.utils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:15 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating existing volume attachment record: 50d8631d-c61c-4086-bd3d-83d279133bb6 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:43:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:43:17 user nova-compute[73476]: INFO nova.compute.manager [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] instance snapshotting
Aug 26 20:43:17 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Beginning live snapshot process
Aug 26 20:43:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json -f qcow2 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json -f qcow2 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvvi912uw/895ea111860548638708914a9870b8c4.delta 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvvi912uw/895ea111860548638708914a9870b8c4.delta 1073741824" returned: 0 in 0.051s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 20:43:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73476) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 20:43:18 user nova-compute[73476]: INFO nova.virt.libvirt.host [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] UEFI support detected
Aug 26 20:43:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:43:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:43:20 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 20:43:20 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:43:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvvi912uw/895ea111860548638708914a9870b8c4.delta /opt/stack/data/nova/instances/snapshots/tmpvvi912uw/895ea111860548638708914a9870b8c4 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvvi912uw/895ea111860548638708914a9870b8c4.delta /opt/stack/data/nova/instances/snapshots/tmpvvi912uw/895ea111860548638708914a9870b8c4" returned: 0 in 0.411s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:20 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Snapshot extracted, beginning image upload
Aug 26 20:43:22 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:22 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:43:23 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Snapshot image upload complete
Aug 26 20:43:23 user nova-compute[73476]: INFO nova.compute.manager [None req-ab8e7b8f-d928-4858-92c8-ef90265b2c1d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Took 5.38 seconds to snapshot the instance on the hypervisor.
Aug 26 20:43:23 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 20:43:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:43:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 20:43:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:24 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:26 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-96693e8a-42c9-4d0a-84db-84c532037a09 req-6f26c676-7194-4e28-8797-b2d72a26ddf0 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received event network-changed-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-96693e8a-42c9-4d0a-84db-84c532037a09 req-6f26c676-7194-4e28-8797-b2d72a26ddf0 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Refreshing instance network info cache due to event network-changed-b6751288-099f-4014-9eaa-40b28f0baec4. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-96693e8a-42c9-4d0a-84db-84c532037a09 req-6f26c676-7194-4e28-8797-b2d72a26ddf0 service nova] Acquiring lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-96693e8a-42c9-4d0a-84db-84c532037a09 req-6f26c676-7194-4e28-8797-b2d72a26ddf0 service nova] Acquired lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG nova.network.neutron [req-96693e8a-42c9-4d0a-84db-84c532037a09 req-6f26c676-7194-4e28-8797-b2d72a26ddf0 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Refreshing network info cache for port b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:27 user nova-compute[73476]: INFO nova.virt.block_device [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Booting with volume 037f4410-54f5-490f-a088-57d89b2e1f50 at /dev/vdc
Aug 26 20:43:27 user nova-compute[73476]: INFO nova.compute.manager [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Rescuing
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquired lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG nova.network.neutron [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG os_brick.utils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0246c97-ece0-4154-b35e-2d4b310099be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d998ad-701a-4e03-b57b-e94a700f275d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce83a7c-c61b-450b-aff5-fef8ee17712b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ccc28-f336-416b-ba01-75307eba3fc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:27 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed9b403-b401-425f-a0fc-2226c675b538]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG os_brick.utils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating existing volume attachment record: 0578e470-af0f-416e-974b-cc675805e800 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG nova.objects.instance [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lazy-loading 'flavor' on Instance uuid e2e5572a-5c09-4217-a5db-c05ebf3227e9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:28 user nova-compute[73476]: INFO nova.compute.manager [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Attaching volume b20f0f1c-4306-4e5e-981a-ffdf0098cc78 to /dev/vdb
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG os_brick.utils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5da9f8d-d26e-4ef7-9876-8d8d5e1521e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG nova.network.neutron [req-96693e8a-42c9-4d0a-84db-84c532037a09 req-6f26c676-7194-4e28-8797-b2d72a26ddf0 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Updated VIF entry in instance network info cache for port b6751288-099f-4014-9eaa-40b28f0baec4. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG nova.network.neutron [req-96693e8a-42c9-4d0a-84db-84c532037a09 req-6f26c676-7194-4e28-8797-b2d72a26ddf0 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Updating instance_info_cache with network_info: [{"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ca50b5-80ac-4d8f-b006-19133f86a2e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-96693e8a-42c9-4d0a-84db-84c532037a09 req-6f26c676-7194-4e28-8797-b2d72a26ddf0 service nova] Releasing lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f608ae-4005-4fc6-9a53-b7f266193f5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e80acb6-ec0b-43f5-8d06-8fc0a195b4cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:28 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[78981809-4756-4eeb-afa4-aef83f873796]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG os_brick.utils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Updating existing volume attachment record: 6a7bdd9b-4faa-4052-a0b7-722f5c38a48b {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG nova.network.neutron [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Updating instance_info_cache with network_info: [{"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Releasing lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-0cf48476-cb0f-4a9e-a5b8-a784947d082c req-bce8cb74-2612-4500-99ca-feeaaca31ac5 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-unplugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0cf48476-cb0f-4a9e-a5b8-a784947d082c req-bce8cb74-2612-4500-99ca-feeaaca31ac5 service nova] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0cf48476-cb0f-4a9e-a5b8-a784947d082c req-bce8cb74-2612-4500-99ca-feeaaca31ac5 service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0cf48476-cb0f-4a9e-a5b8-a784947d082c req-bce8cb74-2612-4500-99ca-feeaaca31ac5 service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-0cf48476-cb0f-4a9e-a5b8-a784947d082c req-bce8cb74-2612-4500-99ca-feeaaca31ac5 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] No waiting events found dispatching network-vif-unplugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:28 user nova-compute[73476]: WARNING nova.compute.manager [req-0cf48476-cb0f-4a9e-a5b8-a784947d082c req-bce8cb74-2612-4500-99ca-feeaaca31ac5 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received unexpected event network-vif-unplugged-15b711e1-203e-49ef-b25b-fac751706ef3 for instance with vm_state active and task_state rescuing.
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-9cb8a310-0d93-478f-b4d3-60e28429de5e req-dfe8ac59-aa75-406c-89d0-f852bc9dad4e service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-changed-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-9cb8a310-0d93-478f-b4d3-60e28429de5e req-dfe8ac59-aa75-406c-89d0-f852bc9dad4e service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Refreshing instance network info cache due to event network-changed-f0b59e8a-1964-4699-81f4-6a9c3b08dae0. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9cb8a310-0d93-478f-b4d3-60e28429de5e req-dfe8ac59-aa75-406c-89d0-f852bc9dad4e service nova] Acquiring lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9cb8a310-0d93-478f-b4d3-60e28429de5e req-dfe8ac59-aa75-406c-89d0-f852bc9dad4e service nova] Acquired lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.network.neutron [req-9cb8a310-0d93-478f-b4d3-60e28429de5e req-dfe8ac59-aa75-406c-89d0-f852bc9dad4e service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Refreshing network info cache for port f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Instance destroyed successfully.
Aug 26 20:43:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Attempting rescue
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73476) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Instance directory exists: not creating {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 20:43:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Creating image(s)
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'trusted_certs' on Instance uuid 13e8971f-2d6c-4f8e-b895-411db3554e74 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue" returned: 0 in 0.049s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'migration_context' on Instance uuid 13e8971f-2d6c-4f8e-b895-411db3554e74 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.base [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<13e8971f-2d6c-4f8e-b895-411db3554e74> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Start _get_guest_xml network_info=[{"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "vif_mac": "fa:16:3e:a8:4f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'resources' on Instance uuid 13e8971f-2d6c-4f8e-b895-411db3554e74 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.base [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<13e8971f-2d6c-4f8e-b895-411db3554e74> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'numa_topology' on Instance uuid 13e8971f-2d6c-4f8e-b895-411db3554e74 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.base [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<13e8971f-2d6c-4f8e-b895-411db3554e74> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.network.neutron [req-9cb8a310-0d93-478f-b4d3-60e28429de5e req-dfe8ac59-aa75-406c-89d0-f852bc9dad4e service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updated VIF entry in instance network info cache for port f0b59e8a-1964-4699-81f4-6a9c3b08dae0. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.network.neutron [req-9cb8a310-0d93-478f-b4d3-60e28429de5e req-dfe8ac59-aa75-406c-89d0-f852bc9dad4e service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance_info_cache with network_info: [{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:29 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:43:29 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'vcpu_model' on Instance uuid 13e8971f-2d6c-4f8e-b895-411db3554e74 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9cb8a310-0d93-478f-b4d3-60e28429de5e req-dfe8ac59-aa75-406c-89d0-f852bc9dad4e service nova] Releasing lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.base [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<13e8971f-2d6c-4f8e-b895-411db3554e74> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1730290434',display_name='tempest-ServerRescueNegativeTestJSON-server-1730290434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1730290434',id=6,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:41:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-kr1306y7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:58Z,user_data=None,user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=13e8971f-2d6c-4f8e-b895-411db3554e74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "vif_mac": "fa:16:3e:a8:4f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "vif_mac": "fa:16:3e:a8:4f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4f:0e,bridge_name='br-int',has_traffic_filtering=True,id=15b711e1-203e-49ef-b25b-fac751706ef3,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b711e1-20') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'pci_devices' on Instance uuid 13e8971f-2d6c-4f8e-b895-411db3554e74 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.objects.base [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<13e8971f-2d6c-4f8e-b895-411db3554e74> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:43:29 user nova-compute[73476]:   <uuid>13e8971f-2d6c-4f8e-b895-411db3554e74</uuid>
Aug 26 20:43:29 user nova-compute[73476]:   <name>instance-00000006</name>
Aug 26 20:43:29 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:43:29 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:43:29 user nova-compute[73476]:   <metadata>
Aug 26 20:43:29 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:43:29 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:43:29 user nova-compute[73476]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1730290434</nova:name>
Aug 26 20:43:29 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:43:29</nova:creationTime>
Aug 26 20:43:29 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:43:29 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:43:29 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:43:29 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:43:29 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:43:29 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:43:29 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:43:29 user nova-compute[73476]:       <nova:owner>
Aug 26 20:43:29 user nova-compute[73476]:         <nova:user uuid="eb63707c9d734bf5b1d1bb20162e3204">tempest-ServerRescueNegativeTestJSON-552908196-project-member</nova:user>
Aug 26 20:43:29 user nova-compute[73476]:         <nova:project uuid="c713d9f0cc5f4dd7a8629ba1b27e72f0">tempest-ServerRescueNegativeTestJSON-552908196</nova:project>
Aug 26 20:43:29 user nova-compute[73476]:       </nova:owner>
Aug 26 20:43:29 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:43:29 user nova-compute[73476]:       <nova:ports>
Aug 26 20:43:29 user nova-compute[73476]:         <nova:port uuid="15b711e1-203e-49ef-b25b-fac751706ef3">
Aug 26 20:43:29 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 20:43:29 user nova-compute[73476]:         </nova:port>
Aug 26 20:43:29 user nova-compute[73476]:       </nova:ports>
Aug 26 20:43:29 user nova-compute[73476]:     </nova:instance>
Aug 26 20:43:29 user nova-compute[73476]:   </metadata>
Aug 26 20:43:29 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:43:29 user nova-compute[73476]:     <system>
Aug 26 20:43:29 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:43:29 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:43:29 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:43:29 user nova-compute[73476]:       <entry name="serial">13e8971f-2d6c-4f8e-b895-411db3554e74</entry>
Aug 26 20:43:29 user nova-compute[73476]:       <entry name="uuid">13e8971f-2d6c-4f8e-b895-411db3554e74</entry>
Aug 26 20:43:29 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:43:29 user nova-compute[73476]:     </system>
Aug 26 20:43:29 user nova-compute[73476]:   </sysinfo>
Aug 26 20:43:29 user nova-compute[73476]:   <os>
Aug 26 20:43:29 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:43:29 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:43:29 user nova-compute[73476]:   </os>
Aug 26 20:43:29 user nova-compute[73476]:   <features>
Aug 26 20:43:29 user nova-compute[73476]:     <acpi/>
Aug 26 20:43:29 user nova-compute[73476]:     <apic/>
Aug 26 20:43:29 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:43:29 user nova-compute[73476]:   </features>
Aug 26 20:43:29 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:43:29 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:43:29 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:43:29 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:43:29 user nova-compute[73476]:   </clock>
Aug 26 20:43:29 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:43:29 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:43:29 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:43:29 user nova-compute[73476]:   </cpu>
Aug 26 20:43:29 user nova-compute[73476]:   <devices>
Aug 26 20:43:29 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:43:29 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:43:29 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue"/>
Aug 26 20:43:29 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:43:29 user nova-compute[73476]:     </disk>
Aug 26 20:43:29 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:43:29 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:43:29 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk"/>
Aug 26 20:43:29 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:43:29 user nova-compute[73476]:     </disk>
Aug 26 20:43:29 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:43:29 user nova-compute[73476]:       <mac address="fa:16:3e:a8:4f:0e"/>
Aug 26 20:43:29 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:29 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:43:29 user nova-compute[73476]:       <target dev="tap15b711e1-20"/>
Aug 26 20:43:29 user nova-compute[73476]:     </interface>
Aug 26 20:43:29 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:43:29 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/console.log" append="off"/>
Aug 26 20:43:29 user nova-compute[73476]:     </serial>
Aug 26 20:43:29 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:43:29 user nova-compute[73476]:     <video>
Aug 26 20:43:29 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:29 user nova-compute[73476]:     </video>
Aug 26 20:43:29 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:43:29 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:43:29 user nova-compute[73476]:     </rng>
Aug 26 20:43:29 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:43:29 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:43:29 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:43:29 user nova-compute[73476]:     </memballoon>
Aug 26 20:43:29 user nova-compute[73476]:   </devices>
Aug 26 20:43:29 user nova-compute[73476]: </domain>
Aug 26 20:43:29 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:43:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Instance destroyed successfully.
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:43:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No VIF found with MAC fa:16:3e:a8:4f:0e, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c896938-71b6-48ab-84cb-68084ebd3300 req-4f3f655b-ced2-4322-98c3-567d0f5b4ec3 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c896938-71b6-48ab-84cb-68084ebd3300 req-4f3f655b-ced2-4322-98c3-567d0f5b4ec3 service nova] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c896938-71b6-48ab-84cb-68084ebd3300 req-4f3f655b-ced2-4322-98c3-567d0f5b4ec3 service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c896938-71b6-48ab-84cb-68084ebd3300 req-4f3f655b-ced2-4322-98c3-567d0f5b4ec3 service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c896938-71b6-48ab-84cb-68084ebd3300 req-4f3f655b-ced2-4322-98c3-567d0f5b4ec3 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] No waiting events found dispatching network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:30 user nova-compute[73476]: WARNING nova.compute.manager [req-3c896938-71b6-48ab-84cb-68084ebd3300 req-4f3f655b-ced2-4322-98c3-567d0f5b4ec3 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received unexpected event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 for instance with vm_state active and task_state rescuing.
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:32 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:43:32 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=6823MB free_disk=25.58621597290039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e2e5572a-5c09-4217-a5db-c05ebf3227e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ad42cf47-42fb-488f-a44f-cf9824dd4d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22c72de3-e06b-4aae-bed9-162101a43e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e9309346-2675-4bfd-9781-175b9b40d71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ee7cf32f-71c2-49ca-8a23-51fc95560974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 5160d9ff-3e26-4743-8e34-ebae9fd95f8b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.manager [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.manager [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] No waiting events found dispatching network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:32 user nova-compute[73476]: WARNING nova.compute.manager [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received unexpected event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 for instance with vm_state active and task_state rescuing.
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.manager [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:32 user nova-compute[73476]: DEBUG nova.compute.manager [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] No waiting events found dispatching network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:32 user nova-compute[73476]: WARNING nova.compute.manager [req-9e7acd65-1223-4c72-bbf4-45057bdbe71f req-b382d811-a409-41be-a773-c366ad95f1ae service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received unexpected event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 for instance with vm_state active and task_state rescuing.
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for 13e8971f-2d6c-4f8e-b895-411db3554e74 due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082613.889525, 13e8971f-2d6c-4f8e-b895-411db3554e74 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:43:33 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] VM Resumed (Lifecycle Event)
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7212ceef-2323-4def-ab4f-edadb8533aff tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:43:33 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082613.8898587, 13e8971f-2d6c-4f8e-b895-411db3554e74 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:43:33 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] VM Started (Lifecycle Event)
Aug 26 20:43:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:43:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:43:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:43:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:43:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-e2e5572a-5c09-4217-a5db-c05ebf3227e9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-e2e5572a-5c09-4217-a5db-c05ebf3227e9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:35 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:43:35 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Updating instance_info_cache with network_info: [{"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-e2e5572a-5c09-4217-a5db-c05ebf3227e9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:43:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:43:39 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Creating image(s)
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Ensure instance console log exists: /opt/stack/data/nova/instances/5160d9ff-3e26-4743-8e34-ebae9fd95f8b/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Start _get_guest_xml network_info=[{"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '2de68e18-1ee5-4a5c-bb33-15923280b842', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stdHwCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7', 'serial': 'fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '50d8631d-c61c-4086-bd3d-83d279133bb6', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZJHixWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b', 'attached_at': '', 'detached_at': '', 'volume_id': 'f72e6e2a-f102-4cb0-9816-192f6763bf1d', 'serial': 'f72e6e2a-f102-4cb0-9816-192f6763bf1d'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '0578e470-af0f-416e-974b-cc675805e800', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHBQADsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b', 'attached_at': '', 'detached_at': '', 'volume_id': '037f4410-54f5-490f-a088-57d89b2e1f50', 'serial': '037f4410-54f5-490f-a088-57d89b2e1f50'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:43:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:43:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connector [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Factory for ISCSI on None {{(pid=73476) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stdHwCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:39 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:43:39 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:43:39 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07d4a37-06c6-4408-b684-713d24063e57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:43:39 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dd5d67-9eec-47e1-bb1a-13373c59427b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7] added
Aug 26 20:43:39 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[31169751-4cae-4081-948f-4108623f6d04]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[295de48f-9487-4333-a645-9fed2e94cd18]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v stdHwCgy {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v stdHwCgy" returned: 0 in 0.097s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[feda96ca-ad26-456d-ade0-be46ffb1a28a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'stdHwCgy'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.101s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8484b159-4458-4056-85fd-f158e529ada4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ff2446-704b-4f06-bdd2-bba620883502]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:43:40 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 20:43:40 user nova-compute[73476]:  {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:43:40 user nova-compute[73476]: WARNING os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 20:43:40 user nova-compute[73476]: 
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec1515e-7671-46a6-a01f-9cd51ed83c70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7, portal: 172.16.0.220,3260]
Aug 26 20:43:40 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7, portal: 172.16.0.220,3260] successful.
Aug 26 20:43:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1396d0-5001-42ff-b962-c8448c01f59b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d914a89c-3bad-47fd-9753-4962583df452]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a4f454-45ac-4d74-81f0-e38b7df395d8]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:43:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stdHwCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '26433336561333033', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433336561333033', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZJHixWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:41 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:43:41 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:43:41 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbce1fe6-55dd-4b2c-86a3-ca99cd41b6c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:43:41 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[09be8c16-69f7-4336-b706-dd019d2f645a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d] added
Aug 26 20:43:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49b6702-3644-4e9c-a1e0-9a018d5a9fbb]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c444c0a2-0613-4c3f-8b00-d4a336e93646]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZJHixWj {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZJHixWj" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2095c030-2e98-4257-9f47-faf2e1b3c4f5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZJHixWj'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[48faa22f-79dd-4656-b1bf-252cdc8c3967]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ff0a9e-4c77-4859-b949-d0d53ec2d796]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e541d7-fb53-4b60-857e-2312b283b22e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d, portal: 172.16.0.220,3260]
Aug 26 20:43:41 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d, portal: 172.16.0.220,3260] successful.
Aug 26 20:43:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[957ec1f8-2bdd-4cab-b43c-fb741a98164f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bb2a25-2ac2-45d3-ba2b-1d9bdfede026]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:41 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:41 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9719d3b-dff6-46dd-9332-a3904045ad3d]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:43:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZJHixWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26163353933626530', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163353933626530', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHBQADsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:42 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:43:42 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:43:42 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cc3ee6-d430-4e04-86bd-9043016eafe5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:43:42 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f15aa6-b77a-4c65-a971-6111cb7daeb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50] added
Aug 26 20:43:42 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[416a8cff-f5c5-40ac-b53e-bab0fc7d2cc5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d004844e-7db2-4b52-8100-7c9c8051fb26]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHBQADsa {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHBQADsa" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce4e9ae-cecf-4613-9eff-17925e666ca4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cHBQADsa'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30dd0f8-119c-468d-86f5-03c50887d2d1]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edd61fc-fe3f-4e9a-aa50-4796113020cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:42 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:42 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:42 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:42 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb705cef-7b5d-4538-a1bb-3a59c3d217d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50, portal: 172.16.0.220,3260]
Aug 26 20:43:42 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50, portal: 172.16.0.220,3260] successful.
Aug 26 20:43:42 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f65bd-ef9d-4787-b310-930253c0911f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f58a82-95eb-4fa6-a5ab-92548ba25eb6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:42 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:42 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:43:42 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:42 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:42 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:43:42 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:43:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2192a28c-2767-4bcb-9930-6e63d4e42622]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:43 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:43:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHBQADsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:43:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23034376661646334', 'path': '/dev/sdd'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034376661646334', 'path': '/dev/sdd'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:79:f0,bridge_name='br-int',has_traffic_filtering=True,id=a1a7a9b5-7aa3-42d6-ab15-63bc93963079,network=Network(954ab838-7f53-4d47-a414-b2cd4cfe696b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1a7a9b5-7a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e3:f9,bridge_name='br-int',has_traffic_filtering=True,id=f52cf477-0f53-45ee-81ec-9c167df18045,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf52cf477-0f') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=39bca6ec-db93-4751-aae8-459cb1493eff,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39bca6ec-db') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=63514087-bf1a-4562-bc47-5d4f2ee425e6,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63514087-bf') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c5:a9,bridge_name='br-int',has_traffic_filtering=True,id=4894df4f-d1e9-4349-9669-0e21ac0d13fd,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4894df4f-d1') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=2014bb91-a4f9-4e38-bf19-164a3ec7b1a4,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2014bb91-a4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:c6,bridge_name='br-int',has_traffic_filtering=True,id=0d363dad-ebd2-4894-ba7c-586441bb567f,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d363dad-eb') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.objects.instance [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lazy-loading 'pci_devices' on Instance uuid 5160d9ff-3e26-4743-8e34-ebae9fd95f8b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:43:44 user nova-compute[73476]:   <uuid>5160d9ff-3e26-4743-8e34-ebae9fd95f8b</uuid>
Aug 26 20:43:44 user nova-compute[73476]:   <name>instance-0000000b</name>
Aug 26 20:43:44 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:43:44 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:43:44 user nova-compute[73476]:   <metadata>
Aug 26 20:43:44 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:43:44 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:43:44 user nova-compute[73476]:       <nova:name>tempest-device-tagging-server-1390994485</nova:name>
Aug 26 20:43:44 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:43:39</nova:creationTime>
Aug 26 20:43:44 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:43:44 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:43:44 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:43:44 user nova-compute[73476]:       <nova:owner>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:user uuid="ea7080831dda481c8f964e501e6037c5">tempest-TaggedBootDevicesTest_v242-1367414827-project-member</nova:user>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:project uuid="ee51467d38d14f2d94d0a172d75d03bc">tempest-TaggedBootDevicesTest_v242-1367414827</nova:project>
Aug 26 20:43:44 user nova-compute[73476]:       </nova:owner>
Aug 26 20:43:44 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:43:44 user nova-compute[73476]:       <nova:ports>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:port uuid="a1a7a9b5-7aa3-42d6-ab15-63bc93963079">
Aug 26 20:43:44 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 20:43:44 user nova-compute[73476]:         </nova:port>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:port uuid="f52cf477-0f53-45ee-81ec-9c167df18045">
Aug 26 20:43:44 user nova-compute[73476]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Aug 26 20:43:44 user nova-compute[73476]:         </nova:port>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:port uuid="39bca6ec-db93-4751-aae8-459cb1493eff">
Aug 26 20:43:44 user nova-compute[73476]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Aug 26 20:43:44 user nova-compute[73476]:         </nova:port>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:port uuid="63514087-bf1a-4562-bc47-5d4f2ee425e6">
Aug 26 20:43:44 user nova-compute[73476]:           <nova:ip type="fixed" address="10.1.1.242" ipVersion="4"/>
Aug 26 20:43:44 user nova-compute[73476]:         </nova:port>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:port uuid="4894df4f-d1e9-4349-9669-0e21ac0d13fd">
Aug 26 20:43:44 user nova-compute[73476]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Aug 26 20:43:44 user nova-compute[73476]:         </nova:port>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:port uuid="2014bb91-a4f9-4e38-bf19-164a3ec7b1a4">
Aug 26 20:43:44 user nova-compute[73476]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 20:43:44 user nova-compute[73476]:         </nova:port>
Aug 26 20:43:44 user nova-compute[73476]:         <nova:port uuid="0d363dad-ebd2-4894-ba7c-586441bb567f">
Aug 26 20:43:44 user nova-compute[73476]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 20:43:44 user nova-compute[73476]:         </nova:port>
Aug 26 20:43:44 user nova-compute[73476]:       </nova:ports>
Aug 26 20:43:44 user nova-compute[73476]:     </nova:instance>
Aug 26 20:43:44 user nova-compute[73476]:   </metadata>
Aug 26 20:43:44 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:43:44 user nova-compute[73476]:     <system>
Aug 26 20:43:44 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:43:44 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:43:44 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:43:44 user nova-compute[73476]:       <entry name="serial">5160d9ff-3e26-4743-8e34-ebae9fd95f8b</entry>
Aug 26 20:43:44 user nova-compute[73476]:       <entry name="uuid">5160d9ff-3e26-4743-8e34-ebae9fd95f8b</entry>
Aug 26 20:43:44 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:43:44 user nova-compute[73476]:     </system>
Aug 26 20:43:44 user nova-compute[73476]:   </sysinfo>
Aug 26 20:43:44 user nova-compute[73476]:   <os>
Aug 26 20:43:44 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:43:44 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:43:44 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:43:44 user nova-compute[73476]:   </os>
Aug 26 20:43:44 user nova-compute[73476]:   <features>
Aug 26 20:43:44 user nova-compute[73476]:     <acpi/>
Aug 26 20:43:44 user nova-compute[73476]:     <apic/>
Aug 26 20:43:44 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:43:44 user nova-compute[73476]:   </features>
Aug 26 20:43:44 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:43:44 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:43:44 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:43:44 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:43:44 user nova-compute[73476]:   </clock>
Aug 26 20:43:44 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:43:44 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:43:44 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:43:44 user nova-compute[73476]:   </cpu>
Aug 26 20:43:44 user nova-compute[73476]:   <devices>
Aug 26 20:43:44 user nova-compute[73476]:     <disk type="file" device="cdrom">
Aug 26 20:43:44 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 20:43:44 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/5160d9ff-3e26-4743-8e34-ebae9fd95f8b/disk.config"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="hda" bus="ide"/>
Aug 26 20:43:44 user nova-compute[73476]:     </disk>
Aug 26 20:43:44 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:43:44 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:43:44 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <serial>fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7</serial>
Aug 26 20:43:44 user nova-compute[73476]:     </disk>
Aug 26 20:43:44 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:43:44 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:43:44 user nova-compute[73476]:       <source dev="/dev/sdc"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <serial>f72e6e2a-f102-4cb0-9816-192f6763bf1d</serial>
Aug 26 20:43:44 user nova-compute[73476]:     </disk>
Aug 26 20:43:44 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:43:44 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:43:44 user nova-compute[73476]:       <source dev="/dev/sdd"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="vdc" bus="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <serial>037f4410-54f5-490f-a088-57d89b2e1f50</serial>
Aug 26 20:43:44 user nova-compute[73476]:     </disk>
Aug 26 20:43:44 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:43:44 user nova-compute[73476]:       <mac address="fa:16:3e:d4:79:f0"/>
Aug 26 20:43:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="tapa1a7a9b5-7a"/>
Aug 26 20:43:44 user nova-compute[73476]:     </interface>
Aug 26 20:43:44 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:43:44 user nova-compute[73476]:       <mac address="fa:16:3e:19:e3:f9"/>
Aug 26 20:43:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="tapf52cf477-0f"/>
Aug 26 20:43:44 user nova-compute[73476]:     </interface>
Aug 26 20:43:44 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:43:44 user nova-compute[73476]:       <mac address="fa:16:3e:90:40:3c"/>
Aug 26 20:43:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="tap39bca6ec-db"/>
Aug 26 20:43:44 user nova-compute[73476]:     </interface>
Aug 26 20:43:44 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:43:44 user nova-compute[73476]:       <mac address="fa:16:3e:7d:cf:74"/>
Aug 26 20:43:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="tap63514087-bf"/>
Aug 26 20:43:44 user nova-compute[73476]:     </interface>
Aug 26 20:43:44 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:43:44 user nova-compute[73476]:       <mac address="fa:16:3e:d1:c5:a9"/>
Aug 26 20:43:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="tap4894df4f-d1"/>
Aug 26 20:43:44 user nova-compute[73476]:     </interface>
Aug 26 20:43:44 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:43:44 user nova-compute[73476]:       <mac address="fa:16:3e:41:14:bf"/>
Aug 26 20:43:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="tap2014bb91-a4"/>
Aug 26 20:43:44 user nova-compute[73476]:     </interface>
Aug 26 20:43:44 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:43:44 user nova-compute[73476]:       <mac address="fa:16:3e:6d:45:c6"/>
Aug 26 20:43:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:43:44 user nova-compute[73476]:       <target dev="tap0d363dad-eb"/>
Aug 26 20:43:44 user nova-compute[73476]:     </interface>
Aug 26 20:43:44 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:43:44 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/5160d9ff-3e26-4743-8e34-ebae9fd95f8b/console.log" append="off"/>
Aug 26 20:43:44 user nova-compute[73476]:     </serial>
Aug 26 20:43:44 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:43:44 user nova-compute[73476]:     <video>
Aug 26 20:43:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:43:44 user nova-compute[73476]:     </video>
Aug 26 20:43:44 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:43:44 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:43:44 user nova-compute[73476]:     </rng>
Aug 26 20:43:44 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:43:44 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:43:44 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:43:44 user nova-compute[73476]:     </memballoon>
Aug 26 20:43:44 user nova-compute[73476]:   </devices>
Aug 26 20:43:44 user nova-compute[73476]: </domain>
Aug 26 20:43:44 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:79:f0,bridge_name='br-int',has_traffic_filtering=True,id=a1a7a9b5-7aa3-42d6-ab15-63bc93963079,network=Network(954ab838-7f53-4d47-a414-b2cd4cfe696b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1a7a9b5-7a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:79:f0,bridge_name='br-int',has_traffic_filtering=True,id=a1a7a9b5-7aa3-42d6-ab15-63bc93963079,network=Network(954ab838-7f53-4d47-a414-b2cd4cfe696b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1a7a9b5-7a') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1a7a9b5-7a, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1a7a9b5-7a, col_values=(('external_ids', {'iface-id': 'a1a7a9b5-7aa3-42d6-ab15-63bc93963079', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:79:f0', 'vm-uuid': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: INFO os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:79:f0,bridge_name='br-int',has_traffic_filtering=True,id=a1a7a9b5-7aa3-42d6-ab15-63bc93963079,network=Network(954ab838-7f53-4d47-a414-b2cd4cfe696b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1a7a9b5-7a')
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e3:f9,bridge_name='br-int',has_traffic_filtering=True,id=f52cf477-0f53-45ee-81ec-9c167df18045,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf52cf477-0f') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e3:f9,bridge_name='br-int',has_traffic_filtering=True,id=f52cf477-0f53-45ee-81ec-9c167df18045,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf52cf477-0f') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf52cf477-0f, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf52cf477-0f, col_values=(('external_ids', {'iface-id': 'f52cf477-0f53-45ee-81ec-9c167df18045', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:e3:f9', 'vm-uuid': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: INFO os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e3:f9,bridge_name='br-int',has_traffic_filtering=True,id=f52cf477-0f53-45ee-81ec-9c167df18045,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf52cf477-0f')
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=39bca6ec-db93-4751-aae8-459cb1493eff,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39bca6ec-db') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=39bca6ec-db93-4751-aae8-459cb1493eff,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39bca6ec-db') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39bca6ec-db, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39bca6ec-db, col_values=(('external_ids', {'iface-id': '39bca6ec-db93-4751-aae8-459cb1493eff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:40:3c', 'vm-uuid': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: INFO os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=39bca6ec-db93-4751-aae8-459cb1493eff,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39bca6ec-db')
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=63514087-bf1a-4562-bc47-5d4f2ee425e6,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63514087-bf') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=63514087-bf1a-4562-bc47-5d4f2ee425e6,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63514087-bf') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63514087-bf, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63514087-bf, col_values=(('external_ids', {'iface-id': '63514087-bf1a-4562-bc47-5d4f2ee425e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:cf:74', 'vm-uuid': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: INFO os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=63514087-bf1a-4562-bc47-5d4f2ee425e6,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63514087-bf')
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c5:a9,bridge_name='br-int',has_traffic_filtering=True,id=4894df4f-d1e9-4349-9669-0e21ac0d13fd,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4894df4f-d1') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c5:a9,bridge_name='br-int',has_traffic_filtering=True,id=4894df4f-d1e9-4349-9669-0e21ac0d13fd,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4894df4f-d1') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4894df4f-d1, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4894df4f-d1, col_values=(('external_ids', {'iface-id': '4894df4f-d1e9-4349-9669-0e21ac0d13fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:c5:a9', 'vm-uuid': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: INFO os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c5:a9,bridge_name='br-int',has_traffic_filtering=True,id=4894df4f-d1e9-4349-9669-0e21ac0d13fd,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4894df4f-d1')
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=2014bb91-a4f9-4e38-bf19-164a3ec7b1a4,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2014bb91-a4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=2014bb91-a4f9-4e38-bf19-164a3ec7b1a4,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2014bb91-a4') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2014bb91-a4, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2014bb91-a4, col_values=(('external_ids', {'iface-id': '2014bb91-a4f9-4e38-bf19-164a3ec7b1a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:14:bf', 'vm-uuid': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: INFO os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=2014bb91-a4f9-4e38-bf19-164a3ec7b1a4,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2014bb91-a4')
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:c6,bridge_name='br-int',has_traffic_filtering=True,id=0d363dad-ebd2-4894-ba7c-586441bb567f,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d363dad-eb') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:c6,bridge_name='br-int',has_traffic_filtering=True,id=0d363dad-ebd2-4894-ba7c-586441bb567f,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d363dad-eb') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d363dad-eb, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d363dad-eb, col_values=(('external_ids', {'iface-id': '0d363dad-ebd2-4894-ba7c-586441bb567f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:45:c6', 'vm-uuid': '5160d9ff-3e26-4743-8e34-ebae9fd95f8b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:44 user nova-compute[73476]: INFO os_vif [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:c6,bridge_name='br-int',has_traffic_filtering=True,id=0d363dad-ebd2-4894-ba7c-586441bb567f,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d363dad-eb')
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] No BDM found with device name hda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] No VIF found with MAC fa:16:3e:d4:79:f0, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] No VIF found with MAC fa:16:3e:d1:c5:a9, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:43:44 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Using config drive
Aug 26 20:43:44 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Creating config drive at /opt/stack/data/nova/instances/5160d9ff-3e26-4743-8e34-ebae9fd95f8b/disk.config
Aug 26 20:43:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5160d9ff-3e26-4743-8e34-ebae9fd95f8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb5arq9e6 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5160d9ff-3e26-4743-8e34-ebae9fd95f8b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb5arq9e6" returned: 0 in 0.068s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-0ee16170-e6f4-4478-8d53-19fe0786e286 req-4d8fe4fd-ae0e-4345-a348-50e7e1381f38 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ee16170-e6f4-4478-8d53-19fe0786e286 req-4d8fe4fd-ae0e-4345-a348-50e7e1381f38 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ee16170-e6f4-4478-8d53-19fe0786e286 req-4d8fe4fd-ae0e-4345-a348-50e7e1381f38 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0ee16170-e6f4-4478-8d53-19fe0786e286 req-4d8fe4fd-ae0e-4345-a348-50e7e1381f38 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-0ee16170-e6f4-4478-8d53-19fe0786e286 req-4d8fe4fd-ae0e-4345-a348-50e7e1381f38 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:46 user nova-compute[73476]: WARNING nova.compute.manager [req-0ee16170-e6f4-4478-8d53-19fe0786e286 req-4d8fe4fd-ae0e-4345-a348-50e7e1381f38 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 for instance with vm_state building and task_state spawning.
Aug 26 20:43:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-e6590992-4a7f-4ae6-8432-b7aa7e4a1303 req-9a3df130-dd8b-47f8-aaaf-e039c3b9ff34 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e6590992-4a7f-4ae6-8432-b7aa7e4a1303 req-9a3df130-dd8b-47f8-aaaf-e039c3b9ff34 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e6590992-4a7f-4ae6-8432-b7aa7e4a1303 req-9a3df130-dd8b-47f8-aaaf-e039c3b9ff34 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e6590992-4a7f-4ae6-8432-b7aa7e4a1303 req-9a3df130-dd8b-47f8-aaaf-e039c3b9ff34 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-e6590992-4a7f-4ae6-8432-b7aa7e4a1303 req-9a3df130-dd8b-47f8-aaaf-e039c3b9ff34 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:47 user nova-compute[73476]: WARNING nova.compute.manager [req-e6590992-4a7f-4ae6-8432-b7aa7e4a1303 req-9a3df130-dd8b-47f8-aaaf-e039c3b9ff34 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-f52cf477-0f53-45ee-81ec-9c167df18045 for instance with vm_state building and task_state spawning.
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-9563a47e-9006-44b2-a713-c2f52b54658f req-f7e7ae98-5725-41c9-a75c-10e71a315b5d service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9563a47e-9006-44b2-a713-c2f52b54658f req-f7e7ae98-5725-41c9-a75c-10e71a315b5d service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9563a47e-9006-44b2-a713-c2f52b54658f req-f7e7ae98-5725-41c9-a75c-10e71a315b5d service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9563a47e-9006-44b2-a713-c2f52b54658f req-f7e7ae98-5725-41c9-a75c-10e71a315b5d service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-9563a47e-9006-44b2-a713-c2f52b54658f req-f7e7ae98-5725-41c9-a75c-10e71a315b5d service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:47 user nova-compute[73476]: WARNING nova.compute.manager [req-9563a47e-9006-44b2-a713-c2f52b54658f req-f7e7ae98-5725-41c9-a75c-10e71a315b5d service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-39bca6ec-db93-4751-aae8-459cb1493eff for instance with vm_state building and task_state spawning.
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:48 user nova-compute[73476]: WARNING nova.compute.manager [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 for instance with vm_state building and task_state spawning.
Aug 26 20:43:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:48 user nova-compute[73476]: WARNING nova.compute.manager [req-080bc94a-5e24-4b9c-bbc3-bbfaba2f1c4e req-831ccfea-b42a-4b82-9331-41678665643c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd for instance with vm_state building and task_state spawning.
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-c6d85114-2a25-4f26-b66c-1355a35294a8 req-8420b3c7-5753-43d1-be19-c57202a4dd89 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c6d85114-2a25-4f26-b66c-1355a35294a8 req-8420b3c7-5753-43d1-be19-c57202a4dd89 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c6d85114-2a25-4f26-b66c-1355a35294a8 req-8420b3c7-5753-43d1-be19-c57202a4dd89 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c6d85114-2a25-4f26-b66c-1355a35294a8 req-8420b3c7-5753-43d1-be19-c57202a4dd89 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-c6d85114-2a25-4f26-b66c-1355a35294a8 req-8420b3c7-5753-43d1-be19-c57202a4dd89 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:49 user nova-compute[73476]: WARNING nova.compute.manager [req-c6d85114-2a25-4f26-b66c-1355a35294a8 req-8420b3c7-5753-43d1-be19-c57202a4dd89 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-f52cf477-0f53-45ee-81ec-9c167df18045 for instance with vm_state building and task_state spawning.
Aug 26 20:43:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:49 user nova-compute[73476]: WARNING nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-39bca6ec-db93-4751-aae8-459cb1493eff for instance with vm_state building and task_state spawning.
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:49 user nova-compute[73476]: WARNING nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 for instance with vm_state building and task_state spawning.
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:49 user nova-compute[73476]: WARNING nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 for instance with vm_state building and task_state spawning.
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:49 user nova-compute[73476]: WARNING nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 for instance with vm_state building and task_state spawning.
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:49 user nova-compute[73476]: WARNING nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 for instance with vm_state building and task_state spawning.
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:49 user nova-compute[73476]: WARNING nova.compute.manager [req-f1a77b08-09ed-4f91-86e9-b997ced7ca18 req-f89ea1a9-9ffc-4c30-9d38-87ac7f2d0008 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-0d363dad-ebd2-4894-ba7c-586441bb567f for instance with vm_state building and task_state spawning.
Aug 26 20:43:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:50 user nova-compute[73476]: WARNING nova.compute.manager [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd for instance with vm_state building and task_state spawning.
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-changed-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Refreshing instance network info cache due to event network-changed-5378ea4f-5e56-4d66-a742-9b132fbc6160. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] Acquiring lock "refresh_cache-22c72de3-e06b-4aae-bed9-162101a43e6f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] Acquired lock "refresh_cache-22c72de3-e06b-4aae-bed9-162101a43e6f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.network.neutron [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Refreshing network info cache for port 5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082630.9084225, 5160d9ff-3e26-4743-8e34-ebae9fd95f8b => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:43:50 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] VM Resumed (Lifecycle Event)
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:43:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance spawned successfully.
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:43:50 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:43:50 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082630.9142249, 5160d9ff-3e26-4743-8e34-ebae9fd95f8b => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:43:50 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] VM Started (Lifecycle Event)
Aug 26 20:43:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:43:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:43:51 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:43:51 user nova-compute[73476]: INFO nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Took 11.33 seconds to spawn the instance on the hypervisor.
Aug 26 20:43:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:43:51 user nova-compute[73476]: INFO nova.compute.manager [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Took 51.11 seconds to build instance.
Aug 26 20:43:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c0e78a62-6f4d-4b49-a0eb-bf82b5799d8e tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.214s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Updated VIF entry in instance network info cache for port 5378ea4f-5e56-4d66-a742-9b132fbc6160. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:43:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Updating instance_info_cache with network_info: [{"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:43:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a4291d12-4b0e-4a3b-834a-14e7648f9c11 req-284a0b89-55fe-4560-a520-9e5dfeb96f23 service nova] Releasing lock "refresh_cache-22c72de3-e06b-4aae-bed9-162101a43e6f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:43:51 user nova-compute[73476]: DEBUG nova.compute.manager [req-f5a77b47-882c-4834-a5d5-a827ce8cb190 req-467692ea-849c-492b-b870-872e51df158d service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f5a77b47-882c-4834-a5d5-a827ce8cb190 req-467692ea-849c-492b-b870-872e51df158d service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f5a77b47-882c-4834-a5d5-a827ce8cb190 req-467692ea-849c-492b-b870-872e51df158d service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f5a77b47-882c-4834-a5d5-a827ce8cb190 req-467692ea-849c-492b-b870-872e51df158d service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:51 user nova-compute[73476]: DEBUG nova.compute.manager [req-f5a77b47-882c-4834-a5d5-a827ce8cb190 req-467692ea-849c-492b-b870-872e51df158d service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:51 user nova-compute[73476]: WARNING nova.compute.manager [req-f5a77b47-882c-4834-a5d5-a827ce8cb190 req-467692ea-849c-492b-b870-872e51df158d service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-0d363dad-ebd2-4894-ba7c-586441bb567f for instance with vm_state active and task_state None.
Aug 26 20:43:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lazy-loading 'flavor' on Instance uuid 22c72de3-e06b-4aae-bed9-162101a43e6f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:54 user nova-compute[73476]: INFO nova.compute.manager [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Attaching volume e0ef6572-bd56-43fe-a109-70817232b7d4 to /dev/vdb
Aug 26 20:43:54 user nova-compute[73476]: DEBUG os_brick.utils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e98ba0-d1ef-4cf8-ab51-98df59d86094]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c686e73-8679-419d-bfd2-3837557be153]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a50c2-4985-45ef-8730-29b1c7e05abf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac09836-233d-4500-9f10-621fe80bf0f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:43:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:43:55 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:43:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f098339-6052-4e86-8275-028d69f6c005]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:43:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:43:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:43:55 user nova-compute[73476]: DEBUG os_brick.utils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:55 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Updating existing volume attachment record: a2fa84b1-dbc5-4a97-8b0c-d9ac92550b04 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDBNXoAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:56 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:43:56 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:43:56 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c52e6e-96df-457a-81ff-dc6d97d0281b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:43:56 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb5fe16-eb9d-4acd-8486-5a7eaaea3a1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78] added
Aug 26 20:43:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae75712-3c7d-44a7-8492-b50181ca6ec4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dd0eec-f733-4368-b9fd-41a11440ac1f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDBNXoAL {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDBNXoAL" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f2e160-4da9-4f06-8974-0acccb232c30]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kDBNXoAL'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5bcfe8-1813-459a-ae2c-1578a0371877]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e977e50c-ea94-453a-894d-88298efe40d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab129120-15cc-4cdc-8d4e-34288a3ade70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78, portal: 172.16.0.220,3260]
Aug 26 20:43:56 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78, portal: 172.16.0.220,3260] successful.
Aug 26 20:43:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[379ecaba-32d3-48ea-ac65-f32026f5f6c9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2e107b-15dd-4ddf-8f43-b0cf20992410]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 (non-flash)
Aug 26 20:43:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a82a526-74fd-4184-876a-02bf97a5f758]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:43:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDBNXoAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:43:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:43:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23432326336383537', 'path': '/dev/sde'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432326336383537', 'path': '/dev/sde'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:43:57 user nova-compute[73476]: DEBUG nova.objects.instance [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lazy-loading 'flavor' on Instance uuid e2e5572a-5c09-4217-a5db-c05ebf3227e9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:43:57 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:43:57 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:43:57 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:43:57 user nova-compute[73476]:   <serial>b20f0f1c-4306-4e5e-981a-ffdf0098cc78</serial>
Aug 26 20:43:57 user nova-compute[73476]: </disk>
Aug 26 20:43:57 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:43:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:43:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:43:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] No VIF found with MAC fa:16:3e:58:0b:2f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0ac8546c-7d91-4cf2-8352-9bedaf1b6821 tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.785s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:58 user nova-compute[73476]: INFO nova.compute.manager [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Terminating instance
Aug 26 20:43:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-a7cb16ba-3dca-41f0-abec-f322eb1665ea req-29ce9ffa-c112-4097-8795-b0829390ab40 service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-unplugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a7cb16ba-3dca-41f0-abec-f322eb1665ea req-29ce9ffa-c112-4097-8795-b0829390ab40 service nova] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a7cb16ba-3dca-41f0-abec-f322eb1665ea req-29ce9ffa-c112-4097-8795-b0829390ab40 service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a7cb16ba-3dca-41f0-abec-f322eb1665ea req-29ce9ffa-c112-4097-8795-b0829390ab40 service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-a7cb16ba-3dca-41f0-abec-f322eb1665ea req-29ce9ffa-c112-4097-8795-b0829390ab40 service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] No waiting events found dispatching network-vif-unplugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-a7cb16ba-3dca-41f0-abec-f322eb1665ea req-29ce9ffa-c112-4097-8795-b0829390ab40 service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-unplugged-db846f89-fbfe-4732-af40-f05c9e0842ad for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:43:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Instance destroyed successfully.
Aug 26 20:43:59 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lazy-loading 'resources' on Instance uuid e2e5572a-5c09-4217-a5db-c05ebf3227e9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1657633063',display_name='tempest-DeleteServersTestJSON-server-1657633063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1657633063',id=2,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:41:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bedf64639896481fa1ab2f57fda22d85',ramdisk_id='',reservation_id='r-gks0dbjf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-792701511',owner_user_name='tempest-DeleteServersTestJSON-792701511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:41:50Z,user_data=None,user_id='f012ed860c7c45f99300efaf9cc09145',uuid=e2e5572a-5c09-4217-a5db-c05ebf3227e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Converting VIF {"id": "db846f89-fbfe-4732-af40-f05c9e0842ad", "address": "fa:16:3e:58:0b:2f", "network": {"id": "9d5fb04e-2127-45c8-af85-e7b8021288b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1286575678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bedf64639896481fa1ab2f57fda22d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb846f89-fb", "ovs_interfaceid": "db846f89-fbfe-4732-af40-f05c9e0842ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:0b:2f,bridge_name='br-int',has_traffic_filtering=True,id=db846f89-fbfe-4732-af40-f05c9e0842ad,network=Network(9d5fb04e-2127-45c8-af85-e7b8021288b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb846f89-fb') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_vif [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:0b:2f,bridge_name='br-int',has_traffic_filtering=True,id=db846f89-fbfe-4732-af40-f05c9e0842ad,network=Network(9d5fb04e-2127-45c8-af85-e7b8021288b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb846f89-fb') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb846f89-fb, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: INFO os_vif [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:0b:2f,bridge_name='br-int',has_traffic_filtering=True,id=db846f89-fbfe-4732-af40-f05c9e0842ad,network=Network(9d5fb04e-2127-45c8-af85-e7b8021288b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb846f89-fb')
Aug 26 20:43:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDBNXoAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:43:59 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e3658-9075-4b4f-9f4d-57b2a408e049]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd22c8a-822b-434f-a6fb-bb28cdbf4faa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:59 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:59 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:43:59 user nova-compute[73476]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 (non-flash)
Aug 26 20:43:59 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:43:59 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:43:59 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:43:59 user nova-compute[73476]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 (non-flash)
Aug 26 20:43:59 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b075f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78'): ({'sde'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Removing single pathed devices sde {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa224d5-403e-43a9-bb03-11254863b49f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.045s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f3428-45bb-4772-af09-a165a5966737]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Flushing IO for device /dev/sde {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[200f62a2-0aca-4a30-9ac4-4ef34c861d96]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36cb7b6-2d5e-41d0-a831-8cef5db8c0fd]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00dad0b-f869-4045-aef6-6cc3ba6d4e9a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[983f396d-4a9c-494c-a838-bb7ba1d9bfd0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78, portal: 172.16.0.220,3260]
Aug 26 20:43:59 user nova-compute[73476]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78, portal: 172.16.0.220,3260] successful.
Aug 26 20:43:59 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20f0f1c-4306-4e5e-981a-ffdf0098cc78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a397e7-8df2-4bf9-b215-d614aca08336]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] <== disconnect_volume: return (349ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:43:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Deleting instance files /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9_del
Aug 26 20:43:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Deletion of /opt/stack/data/nova/instances/e2e5572a-5c09-4217-a5db-c05ebf3227e9_del complete
Aug 26 20:43:59 user nova-compute[73476]: INFO nova.compute.manager [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 26 20:43:59 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:43:59 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:44:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] No waiting events found dispatching network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:01 user nova-compute[73476]: WARNING nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received unexpected event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad for instance with vm_state active and task_state deleting.
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] No waiting events found dispatching network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:01 user nova-compute[73476]: WARNING nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received unexpected event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad for instance with vm_state active and task_state deleting.
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] No waiting events found dispatching network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:01 user nova-compute[73476]: WARNING nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received unexpected event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad for instance with vm_state active and task_state deleting.
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-unplugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] No waiting events found dispatching network-vif-unplugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3d376be-cbee-4a6a-ba45-6d26ee99b64a req-cbe1fbf8-022f-4aca-b009-dab9cbfcf74d service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-unplugged-db846f89-fbfe-4732-af40-f05c9e0842ad for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:44:01 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:01 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Took 1.28 seconds to deallocate network for instance.
Aug 26 20:44:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-83d1e831-5748-4a9b-b673-34acd10760d7 req-fb45686e-32b7-4f4a-9820-3b17acb1fcec service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-83d1e831-5748-4a9b-b673-34acd10760d7 req-fb45686e-32b7-4f4a-9820-3b17acb1fcec service nova] Acquiring lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-83d1e831-5748-4a9b-b673-34acd10760d7 req-fb45686e-32b7-4f4a-9820-3b17acb1fcec service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-83d1e831-5748-4a9b-b673-34acd10760d7 req-fb45686e-32b7-4f4a-9820-3b17acb1fcec service nova] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-83d1e831-5748-4a9b-b673-34acd10760d7 req-fb45686e-32b7-4f4a-9820-3b17acb1fcec service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] No waiting events found dispatching network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:03 user nova-compute[73476]: WARNING nova.compute.manager [req-83d1e831-5748-4a9b-b673-34acd10760d7 req-fb45686e-32b7-4f4a-9820-3b17acb1fcec service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received unexpected event network-vif-plugged-db846f89-fbfe-4732-af40-f05c9e0842ad for instance with vm_state active and task_state deleting.
Aug 26 20:44:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-83d1e831-5748-4a9b-b673-34acd10760d7 req-fb45686e-32b7-4f4a-9820-3b17acb1fcec service nova] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Received event network-vif-deleted-db846f89-fbfe-4732-af40-f05c9e0842ad {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-2ae4d33c-da9e-46b0-b641-1aade92789c5 req-066066d2-6f2f-498f-b681-fe6272e28464 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-changed-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-2ae4d33c-da9e-46b0-b641-1aade92789c5 req-066066d2-6f2f-498f-b681-fe6272e28464 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Refreshing instance network info cache due to event network-changed-dc8013cf-f972-4d70-a041-b91ace1b537d. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2ae4d33c-da9e-46b0-b641-1aade92789c5 req-066066d2-6f2f-498f-b681-fe6272e28464 service nova] Acquiring lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2ae4d33c-da9e-46b0-b641-1aade92789c5 req-066066d2-6f2f-498f-b681-fe6272e28464 service nova] Acquired lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-2ae4d33c-da9e-46b0-b641-1aade92789c5 req-066066d2-6f2f-498f-b681-fe6272e28464 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Refreshing network info cache for port dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "interface-8150e248-6046-4d1e-bb7c-3b94cd6d30e5-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "interface-8150e248-6046-4d1e-bb7c-3b94cd6d30e5-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG nova.objects.instance [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lazy-loading 'flavor' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-2ae4d33c-da9e-46b0-b641-1aade92789c5 req-066066d2-6f2f-498f-b681-fe6272e28464 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updated VIF entry in instance network info cache for port dc8013cf-f972-4d70-a041-b91ace1b537d. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-2ae4d33c-da9e-46b0-b641-1aade92789c5 req-066066d2-6f2f-498f-b681-fe6272e28464 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating instance_info_cache with network_info: [{"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2ae4d33c-da9e-46b0-b641-1aade92789c5 req-066066d2-6f2f-498f-b681-fe6272e28464 service nova] Releasing lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG nova.objects.instance [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lazy-loading 'pci_requests' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG nova.objects.base [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Object Instance<8150e248-6046-4d1e-bb7c-3b94cd6d30e5> lazy-loaded attributes: flavor,pci_requests {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:44:07 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG nova.policy [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e9f1517b4574f2dbe3def073c65a0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d347b5c87b440296fde039405de11d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:44:08 user nova-compute[73476]: INFO nova.compute.manager [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Took 7.07 seconds to detach 1 volumes for instance.
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Successfully created port: 2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcKvfngE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:08 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:08 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:08 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5fc878-a772-4fcf-a699-140ece00ba3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:44:08 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39d93ac-5598-4252-8210-f21c65d68fa3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4] added
Aug 26 20:44:08 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4bea37-32ea-4fd0-a856-510594dc3550]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c14f51-6aad-4766-8cec-660dd9ee7393]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcKvfngE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcKvfngE" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3a92c2-844b-4118-8857-04031832c2a5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcKvfngE'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e458e21-0e6e-4c1b-b7e5-ba0b42651777]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:08 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Deleted allocations for instance e2e5572a-5c09-4217-a5db-c05ebf3227e9
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b38e38f-32d6-40b7-bbd2-d70eebecbc6a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:08 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:08 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:08 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:08 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:08 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:08 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1b9af2c7-5d00-40a1-9058-d1209f24413b tempest-DeleteServersTestJSON-792701511 tempest-DeleteServersTestJSON-792701511-project-member] Lock "e2e5572a-5c09-4217-a5db-c05ebf3227e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.356s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.217s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96fcfba-0bc5-477b-9137-f3b77a51c34b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4, portal: 172.16.0.220,3260]
Aug 26 20:44:09 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:09 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae55abe-f76d-4316-80b6-e158a471a002]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[289dbf30-5e46-47bd-a2fd-904d18fe5dd0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:09 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:09 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:09 user nova-compute[73476]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 (non-flash)
Aug 26 20:44:09 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:09 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:09 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:09 user nova-compute[73476]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 (non-flash)
Aug 26 20:44:09 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fbb20b-57c6-4d3e-a45f-9288a104ce6c]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcKvfngE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Successfully updated port: 2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquired lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-af7f55b0-b3ec-4e5c-bf91-4826a8f91ce6 req-e91b47a9-472e-4a32-8b6f-1efcaee09255 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-changed-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-af7f55b0-b3ec-4e5c-bf91-4826a8f91ce6 req-e91b47a9-472e-4a32-8b6f-1efcaee09255 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Refreshing instance network info cache due to event network-changed-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-af7f55b0-b3ec-4e5c-bf91-4826a8f91ce6 req-e91b47a9-472e-4a32-8b6f-1efcaee09255 service nova] Acquiring lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:44:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating instance_info_cache with network_info: [{"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Releasing lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-af7f55b0-b3ec-4e5c-bf91-4826a8f91ce6 req-e91b47a9-472e-4a32-8b6f-1efcaee09255 service nova] Acquired lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.network.neutron [req-af7f55b0-b3ec-4e5c-bf91-4826a8f91ce6 req-e91b47a9-472e-4a32-8b6f-1efcaee09255 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Refreshing network info cache for port 2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309021978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309021978',id=8,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv500ICYQkC8rlDl0rZ7fAGTJyj7kZ3tpS7wPZK0hi+dNo8U4bebGF/MrGe9anTbwaWZhwe37G7Y+gRDfa2LkkTJlaTK44hxXQMKLQOS5XgexamGee3hm5aT5V94z3v7Q==',key_name='tempest-keypair-1352386032',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='59d347b5c87b440296fde039405de11d',ramdisk_id='',reservation_id='r-i0hj5l0a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687865165',owner_user_name='tempest-TaggedAttachmentsTest-687865165-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e9f1517b4574f2dbe3def073c65a0c7',uuid=8150e248-6046-4d1e-bb7c-3b94cd6d30e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converting VIF {"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG os_vif [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e1ca6b5-c6, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e1ca6b5-c6, col_values=(('external_ids', {'iface-id': '2e1ca6b5-c66e-484d-81ef-6024fa1d52b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:a5:9b', 'vm-uuid': '8150e248-6046-4d1e-bb7c-3b94cd6d30e5'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:10 user nova-compute[73476]: INFO os_vif [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6')
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309021978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309021978',id=8,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv500ICYQkC8rlDl0rZ7fAGTJyj7kZ3tpS7wPZK0hi+dNo8U4bebGF/MrGe9anTbwaWZhwe37G7Y+gRDfa2LkkTJlaTK44hxXQMKLQOS5XgexamGee3hm5aT5V94z3v7Q==',key_name='tempest-keypair-1352386032',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='59d347b5c87b440296fde039405de11d',ramdisk_id='',reservation_id='r-i0hj5l0a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687865165',owner_user_name='tempest-TaggedAttachmentsTest-687865165-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e9f1517b4574f2dbe3def073c65a0c7',uuid=8150e248-6046-4d1e-bb7c-3b94cd6d30e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converting VIF {"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] attach device xml: <interface type="ethernet">
Aug 26 20:44:10 user nova-compute[73476]:   <mac address="fa:16:3e:e2:a5:9b"/>
Aug 26 20:44:10 user nova-compute[73476]:   <model type="virtio"/>
Aug 26 20:44:10 user nova-compute[73476]:   <mtu size="1442"/>
Aug 26 20:44:10 user nova-compute[73476]:   <target dev="tap2e1ca6b5-c6"/>
Aug 26 20:44:10 user nova-compute[73476]: </interface>
Aug 26 20:44:10 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.506s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] <== connect_volume: return (1507ms) {'type': 'block', 'scsi_wwn': '26261356364333962', 'path': '/dev/sde'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261356364333962', 'path': '/dev/sde'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.objects.instance [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lazy-loading 'flavor' on Instance uuid 22c72de3-e06b-4aae-bed9-162101a43e6f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:44:10 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:10 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:44:10 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:10 user nova-compute[73476]:   <serial>e0ef6572-bd56-43fe-a109-70817232b7d4</serial>
Aug 26 20:44:10 user nova-compute[73476]: </disk>
Aug 26 20:44:10 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-424fca91-fe1e-4d2e-9a37-a97d946bb4c5 req-7b49f7e9-6d8e-461e-81e9-6e08753ec81d service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-plugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-424fca91-fe1e-4d2e-9a37-a97d946bb4c5 req-7b49f7e9-6d8e-461e-81e9-6e08753ec81d service nova] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-424fca91-fe1e-4d2e-9a37-a97d946bb4c5 req-7b49f7e9-6d8e-461e-81e9-6e08753ec81d service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-424fca91-fe1e-4d2e-9a37-a97d946bb4c5 req-7b49f7e9-6d8e-461e-81e9-6e08753ec81d service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-424fca91-fe1e-4d2e-9a37-a97d946bb4c5 req-7b49f7e9-6d8e-461e-81e9-6e08753ec81d service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] No waiting events found dispatching network-vif-plugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:10 user nova-compute[73476]: WARNING nova.compute.manager [req-424fca91-fe1e-4d2e-9a37-a97d946bb4c5 req-7b49f7e9-6d8e-461e-81e9-6e08753ec81d service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received unexpected event network-vif-plugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 for instance with vm_state active and task_state None.
Aug 26 20:44:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.network.neutron [req-af7f55b0-b3ec-4e5c-bf91-4826a8f91ce6 req-e91b47a9-472e-4a32-8b6f-1efcaee09255 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updated VIF entry in instance network info cache for port 2e1ca6b5-c66e-484d-81ef-6024fa1d52b6. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:44:10 user nova-compute[73476]: DEBUG nova.network.neutron [req-af7f55b0-b3ec-4e5c-bf91-4826a8f91ce6 req-e91b47a9-472e-4a32-8b6f-1efcaee09255 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating instance_info_cache with network_info: [{"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] No BDM found with device name hda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] No VIF found with MAC fa:16:3e:e8:92:f2, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-af7f55b0-b3ec-4e5c-bf91-4826a8f91ce6 req-e91b47a9-472e-4a32-8b6f-1efcaee09255 service nova] Releasing lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:44:11 user nova-compute[73476]:   <nova:package version="0.0.0"/>
Aug 26 20:44:11 user nova-compute[73476]:   <nova:name>tempest-device-tagging-server-1309021978</nova:name>
Aug 26 20:44:11 user nova-compute[73476]:   <nova:creationTime>2023-08-26 20:44:11</nova:creationTime>
Aug 26 20:44:11 user nova-compute[73476]:   <nova:flavor name="m1.tiny">
Aug 26 20:44:11 user nova-compute[73476]:     <nova:memory>512</nova:memory>
Aug 26 20:44:11 user nova-compute[73476]:     <nova:disk>1</nova:disk>
Aug 26 20:44:11 user nova-compute[73476]:     <nova:swap>0</nova:swap>
Aug 26 20:44:11 user nova-compute[73476]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:44:11 user nova-compute[73476]:     <nova:vcpus>1</nova:vcpus>
Aug 26 20:44:11 user nova-compute[73476]:   </nova:flavor>
Aug 26 20:44:11 user nova-compute[73476]:   <nova:owner>
Aug 26 20:44:11 user nova-compute[73476]:     <nova:user uuid="0e9f1517b4574f2dbe3def073c65a0c7">tempest-TaggedAttachmentsTest-687865165-project-member</nova:user>
Aug 26 20:44:11 user nova-compute[73476]:     <nova:project uuid="59d347b5c87b440296fde039405de11d">tempest-TaggedAttachmentsTest-687865165</nova:project>
Aug 26 20:44:11 user nova-compute[73476]:   </nova:owner>
Aug 26 20:44:11 user nova-compute[73476]:   <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:44:11 user nova-compute[73476]:   <nova:ports>
Aug 26 20:44:11 user nova-compute[73476]:     <nova:port uuid="dc8013cf-f972-4d70-a041-b91ace1b537d">
Aug 26 20:44:11 user nova-compute[73476]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:44:11 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:11 user nova-compute[73476]:     <nova:port uuid="2e1ca6b5-c66e-484d-81ef-6024fa1d52b6">
Aug 26 20:44:11 user nova-compute[73476]:       <nova:ip type="fixed" address="10.10.10.159" ipVersion="4"/>
Aug 26 20:44:11 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:11 user nova-compute[73476]:   </nova:ports>
Aug 26 20:44:11 user nova-compute[73476]: </nova:instance>
Aug 26 20:44:11 user nova-compute[73476]:  {{(pid=73476) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] No VIF found with MAC fa:16:3e:19:7f:fd, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c47e72e4-4630-4cb7-a3a7-6403b708bd1e tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "interface-8150e248-6046-4d1e-bb7c-3b94cd6d30e5-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.452s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-67fbf976-e0ad-4b3a-80af-56f7d4d75afb tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.484s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lazy-loading 'flavor' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:11 user nova-compute[73476]: INFO nova.compute.manager [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Attaching volume caf7f5e7-c775-4179-ad9a-3d770b10eef0 to /dev/vdb
Aug 26 20:44:11 user nova-compute[73476]: DEBUG os_brick.utils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98ec2b2-250c-45e1-986e-80ca99e55918]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77dc550-1fb5-437d-aeb1-11799952cca8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a6d81b-4dd7-4055-9646-533b93a5b5cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d906ae-d11a-451c-ae08-6276c83fc6ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:12 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec0164-0e4e-4e4b-b0b7-c9f33ef13407]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG os_brick.utils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating existing volume attachment record: b8bc89d0-b228-4716-9054-0baeb2a3a818 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-892cfb1f-6912-4441-8a1a-b234750b6b52 req-a98d1ad8-59e3-49e5-8cff-caaad4951a86 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received event network-changed-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-892cfb1f-6912-4441-8a1a-b234750b6b52 req-a98d1ad8-59e3-49e5-8cff-caaad4951a86 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Refreshing instance network info cache due to event network-changed-bb78e89a-f134-42de-bf9f-65454e85a33f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-892cfb1f-6912-4441-8a1a-b234750b6b52 req-a98d1ad8-59e3-49e5-8cff-caaad4951a86 service nova] Acquiring lock "refresh_cache-e9309346-2675-4bfd-9781-175b9b40d71e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-892cfb1f-6912-4441-8a1a-b234750b6b52 req-a98d1ad8-59e3-49e5-8cff-caaad4951a86 service nova] Acquired lock "refresh_cache-e9309346-2675-4bfd-9781-175b9b40d71e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG nova.network.neutron [req-892cfb1f-6912-4441-8a1a-b234750b6b52 req-a98d1ad8-59e3-49e5-8cff-caaad4951a86 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Refreshing network info cache for port bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lazy-loading 'flavor' on Instance uuid e9309346-2675-4bfd-9781-175b9b40d71e {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-2fdf4720-1781-4f5c-811e-d9f46d1a3668 req-178d1892-7cbc-4b36-be52-1b93f83359e0 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-plugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2fdf4720-1781-4f5c-811e-d9f46d1a3668 req-178d1892-7cbc-4b36-be52-1b93f83359e0 service nova] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2fdf4720-1781-4f5c-811e-d9f46d1a3668 req-178d1892-7cbc-4b36-be52-1b93f83359e0 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2fdf4720-1781-4f5c-811e-d9f46d1a3668 req-178d1892-7cbc-4b36-be52-1b93f83359e0 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-2fdf4720-1781-4f5c-811e-d9f46d1a3668 req-178d1892-7cbc-4b36-be52-1b93f83359e0 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] No waiting events found dispatching network-vif-plugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:12 user nova-compute[73476]: WARNING nova.compute.manager [req-2fdf4720-1781-4f5c-811e-d9f46d1a3668 req-178d1892-7cbc-4b36-be52-1b93f83359e0 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received unexpected event network-vif-plugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 for instance with vm_state active and task_state None.
Aug 26 20:44:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.150s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:13 user nova-compute[73476]: INFO nova.compute.manager [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Attaching volume 239a1e48-548c-4773-9dd0-861c4010261c to /dev/vdb
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.utils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8035212a-f6c3-4ded-8ec5-e393a592a093]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.network.neutron [req-892cfb1f-6912-4441-8a1a-b234750b6b52 req-a98d1ad8-59e3-49e5-8cff-caaad4951a86 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Updated VIF entry in instance network info cache for port bb78e89a-f134-42de-bf9f-65454e85a33f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.network.neutron [req-892cfb1f-6912-4441-8a1a-b234750b6b52 req-a98d1ad8-59e3-49e5-8cff-caaad4951a86 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Updating instance_info_cache with network_info: [{"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d756aff0-3dec-4ba2-b5a8-c70c8f207003]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-892cfb1f-6912-4441-8a1a-b234750b6b52 req-a98d1ad8-59e3-49e5-8cff-caaad4951a86 service nova] Releasing lock "refresh_cache-e9309346-2675-4bfd-9781-175b9b40d71e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde0c65e-3a4e-444f-aa75-fda9c12846d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d2fbd-bb63-47b6-bb99-88551b36d873]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:13 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e282b4-5a42-4ecb-ac0a-88bb87d381f0]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.utils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Updating existing volume attachment record: 8d7bf58b-bda0-4898-bb6a-b277649a187c {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:13 user nova-compute[73476]: INFO nova.compute.manager [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Detaching volume e0ef6572-bd56-43fe-a109-70817232b7d4
Aug 26 20:44:13 user nova-compute[73476]: INFO nova.virt.block_device [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Attempting to driver detach volume e0ef6572-bd56-43fe-a109-70817232b7d4 from mountpoint /dev/vdb
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Attempting to detach device vdb from instance 22c72de3-e06b-4aae-bed9-162101a43e6f from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:44:13 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:13 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:44:13 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:13 user nova-compute[73476]:   <serial>e0ef6572-bd56-43fe-a109-70817232b7d4</serial>
Aug 26 20:44:13 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:44:13 user nova-compute[73476]: </disk>
Aug 26 20:44:13 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:44:13 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Successfully detached device vdb from instance 22c72de3-e06b-4aae-bed9-162101a43e6f from the persistent domain config.
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22c72de3-e06b-4aae-bed9-162101a43e6f from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:44:13 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:13 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:44:13 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:13 user nova-compute[73476]:   <serial>e0ef6572-bd56-43fe-a109-70817232b7d4</serial>
Aug 26 20:44:13 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:44:13 user nova-compute[73476]: </disk>
Aug 26 20:44:13 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lazy-loading 'flavor' on Instance uuid ee7cf32f-71c2-49ca-8a23-51fc95560974 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693082653.7614174, 22c72de3-e06b-4aae-bed9-162101a43e6f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22c72de3-e06b-4aae-bed9-162101a43e6f {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:44:13 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Successfully detached device vdb from instance 22c72de3-e06b-4aae-bed9-162101a43e6f from the live domain config.
Aug 26 20:44:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcKvfngE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:13 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b319dc4-1985-46a5-882b-4750c3439e6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[25941df4-de69-4948-b88c-727aad5c52e3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:13 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:13 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:13 user nova-compute[73476]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 (non-flash)
Aug 26 20:44:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:13 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:13 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:13 user nova-compute[73476]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 (non-flash)
Aug 26 20:44:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d00aca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4'): ({'sde'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Removing single pathed devices sde {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa3afaf-8625-449a-a76d-e5f347d56a3c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff49168-a462-447c-9b1a-a5de7321e6de]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Flushing IO for device /dev/sde {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3a1525-f3ca-4416-8c4c-3b43faec0580]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28aab2a-d6ca-4e59-94b6-6d558b975959]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:13 user nova-compute[73476]: INFO nova.compute.manager [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Attaching volume 6ce1022b-a6a3-4652-95ca-93f280ebeb2c to /dev/vdb
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46fcc20-c6a0-466f-8230-25c8eb581234]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b404aa-e561-4f8e-b1aa-579dbf8929c4]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4, portal: 172.16.0.220,3260]
Aug 26 20:44:14 user nova-compute[73476]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:14 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0ef6572-bd56-43fe-a109-70817232b7d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5541aba1-4d04-424c-97ee-24d15e665a81]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] <== disconnect_volume: return (293ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.utils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[318ccfaa-9f47-4fc7-8690-cf708a800f4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e83891f-b4fe-4d24-9b83-8c36139a2716]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b46a599-ce14-4a8c-909a-9382efebb426]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[017c29de-266a-498c-81b1-07d34a61d584]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:14 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f6f392-1590-4ccd-a7d4-ac8d92f5b1f5]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG os_brick.utils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Updating existing volume attachment record: b1b7ecce-8a73-4d83-aae7-34bf08e8bb4a {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082639.4599614, e2e5572a-5c09-4217-a5db-c05ebf3227e9 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:44:14 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] VM Stopped (Lifecycle Event)
Aug 26 20:44:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4c2c0edb-ff4d-4232-a8bd-a600130e9e8c None None] [instance: e2e5572a-5c09-4217-a5db-c05ebf3227e9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-b229c6f8-10ac-4d6b-8d38-5f8aeb93b304 req-89af279c-6f9d-4415-a468-dfbc34b88726 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received event network-changed-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-b229c6f8-10ac-4d6b-8d38-5f8aeb93b304 req-89af279c-6f9d-4415-a468-dfbc34b88726 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Refreshing instance network info cache due to event network-changed-4ebaad24-c622-4e30-813a-3566c5edaeca. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b229c6f8-10ac-4d6b-8d38-5f8aeb93b304 req-89af279c-6f9d-4415-a468-dfbc34b88726 service nova] Acquiring lock "refresh_cache-ee7cf32f-71c2-49ca-8a23-51fc95560974" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b229c6f8-10ac-4d6b-8d38-5f8aeb93b304 req-89af279c-6f9d-4415-a468-dfbc34b88726 service nova] Acquired lock "refresh_cache-ee7cf32f-71c2-49ca-8a23-51fc95560974" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG nova.network.neutron [req-b229c6f8-10ac-4d6b-8d38-5f8aeb93b304 req-89af279c-6f9d-4415-a468-dfbc34b88726 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Refreshing network info cache for port 4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG nova.network.neutron [req-b229c6f8-10ac-4d6b-8d38-5f8aeb93b304 req-89af279c-6f9d-4415-a468-dfbc34b88726 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Updated VIF entry in instance network info cache for port 4ebaad24-c622-4e30-813a-3566c5edaeca. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:44:14 user nova-compute[73476]: DEBUG nova.network.neutron [req-b229c6f8-10ac-4d6b-8d38-5f8aeb93b304 req-89af279c-6f9d-4415-a468-dfbc34b88726 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Updating instance_info_cache with network_info: [{"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b229c6f8-10ac-4d6b-8d38-5f8aeb93b304 req-89af279c-6f9d-4415-a468-dfbc34b88726 service nova] Releasing lock "refresh_cache-ee7cf32f-71c2-49ca-8a23-51fc95560974" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:44:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:17 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lazy-loading 'flavor' on Instance uuid 22c72de3-e06b-4aae-bed9-162101a43e6f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6f90a961-0b80-440b-996d-b1b2e49f07da tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.235s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:22 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:44:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGFctswQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:24 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:24 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:24 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259fb25-e83f-40f3-8e5e-1fff335fa0f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:44:24 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abf1c86-876e-4bb3-9548-fb24e9bbaa8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0] added
Aug 26 20:44:24 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[84586e65-f2f3-4e22-989d-95ee1c2cd6de]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[93820be7-5d52-4b9a-b9b9-abc0bb169c3f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGFctswQ {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGFctswQ" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f85d30-7d88-455c-9880-ffd7649f92f9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EGFctswQ'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86db1f1-f3cc-4af5-a9a5-e2bc5b6cd4f4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19981b-6596-4a7d-ba1d-248947cf7df4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8ff954-8809-444d-8ea3-9f08e159ea8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0, portal: 172.16.0.220,3260]
Aug 26 20:44:25 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:25 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed7db0-d5b5-4817-bad9-7931f3ab9fec]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb781a2-e6b5-4307-9fe4-7d8615d74de1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)
Aug 26 20:44:25 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec09703b-8463-4f83-9557-7f0b2779d8b8]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGFctswQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:44:25 user nova-compute[73476]: INFO nova.compute.claims [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Claim successful on node user
Aug 26 20:44:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwEOYgKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:25 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23735636337636466', 'path': '/dev/sdf'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735636337636466', 'path': '/dev/sdf'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.265s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:26 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:26 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lazy-loading 'flavor' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbd8511-d775-47b2-a923-d4bf596bd058]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:44:26 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:44:26 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:26 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:44:26 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:26 user nova-compute[73476]:   <serial>caf7f5e7-c775-4179-ad9a-3d770b10eef0</serial>
Aug 26 20:44:26 user nova-compute[73476]: </disk>
Aug 26 20:44:26 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef5e1ce-2e95-45f8-9f77-bd745fb31ed3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c] added
Aug 26 20:44:26 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ddf245-3653-4cc3-bf71-c5e59d9d933c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cc6047-22fa-4444-9125-90ba3e2acfb6]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwEOYgKU {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwEOYgKU" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d056eb2-c696-40e6-8b69-6ad21f1107ef]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PwEOYgKU'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[642b11f5-948d-4c3a-8e03-42cfb2f0ae22]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfc5680-2ecd-454d-92f4-2007fde47fa6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.policy [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ed2a98f37294fd381fd1dfe7c5c0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679727d63ba04ad48740d1b967be5a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:44:26 user nova-compute[73476]: INFO nova.virt.block_device [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Booting with blank volume at /dev/vda
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3d6324-42f9-45f6-a2e4-caa9b1885e00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260]
Aug 26 20:44:26 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:26 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a871cb-54ed-417d-8cd6-17b139dbd8d8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc73302e-e75b-4b18-98a7-48a502392d64]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:26 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)
Aug 26 20:44:26 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:26 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[afee1f80-0205-4fd7-8f05-307049fb806d]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] No BDM found with device name hda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] No VIF found with MAC fa:16:3e:e8:92:f2, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:44:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e8ffb23-686b-4e49-b9f2-72104ff8f117 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.077s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:27 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:44:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwEOYgKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:44:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] <== connect_volume: return (1638ms) {'type': 'block', 'scsi_wwn': '26664353238623362', 'path': '/dev/sdg'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664353238623362', 'path': '/dev/sdg'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:44:27 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lazy-loading 'flavor' on Instance uuid e9309346-2675-4bfd-9781-175b9b40d71e {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:44:27 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:27 user nova-compute[73476]:   <source dev="/dev/sdg"/>
Aug 26 20:44:27 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:27 user nova-compute[73476]:   <serial>239a1e48-548c-4773-9dd0-861c4010261c</serial>
Aug 26 20:44:27 user nova-compute[73476]: </disk>
Aug 26 20:44:27 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:44:27 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Successfully created port: b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] No VIF found with MAC fa:16:3e:00:8e:85, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:28 user nova-compute[73476]: INFO nova.compute.manager [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Detaching volume caf7f5e7-c775-4179-ad9a-3d770b10eef0
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e682929a-5323-44db-b631-d111acec3246 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.285s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:28 user nova-compute[73476]: INFO nova.virt.block_device [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Attempting to driver detach volume caf7f5e7-c775-4179-ad9a-3d770b10eef0 from mountpoint /dev/vdb
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Attempting to detach device vdb from instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:44:28 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:28 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:44:28 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:28 user nova-compute[73476]:   <serial>caf7f5e7-c775-4179-ad9a-3d770b10eef0</serial>
Aug 26 20:44:28 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 20:44:28 user nova-compute[73476]: </disk>
Aug 26 20:44:28 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:44:28 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Successfully detached device vdb from instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 from the persistent domain config.
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:44:28 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:28 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:44:28 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:28 user nova-compute[73476]:   <serial>caf7f5e7-c775-4179-ad9a-3d770b10eef0</serial>
Aug 26 20:44:28 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 20:44:28 user nova-compute[73476]: </disk>
Aug 26 20:44:28 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Successfully updated port: b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquired lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-ef2cb1e3-ac86-423b-a16e-b2e13372443b req-16c54026-f1e2-476a-8b89-aa4fe9eb5f11 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-changed-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-ef2cb1e3-ac86-423b-a16e-b2e13372443b req-16c54026-f1e2-476a-8b89-aa4fe9eb5f11 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Refreshing instance network info cache due to event network-changed-b51ff675-dbca-4a11-8ed4-a7040a20f850. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ef2cb1e3-ac86-423b-a16e-b2e13372443b req-16c54026-f1e2-476a-8b89-aa4fe9eb5f11 service nova] Acquiring lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693082668.9027493, 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:44:28 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Successfully detached device vdb from instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 from the live domain config.
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGFctswQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:28 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba6df04-f3dc-43b2-adff-9562d04b162c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updating instance_info_cache with network_info: [{"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bad9c25-b026-422d-bc6e-499818c3701f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 (non-flash)
Aug 26 20:44:28 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d0128280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0'): ({'sdf'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Removing single pathed devices sdf {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:44:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Releasing lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Instance network_info: |[{"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ef2cb1e3-ac86-423b-a16e-b2e13372443b req-16c54026-f1e2-476a-8b89-aa4fe9eb5f11 service nova] Acquired lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG nova.network.neutron [req-ef2cb1e3-ac86-423b-a16e-b2e13372443b req-16c54026-f1e2-476a-8b89-aa4fe9eb5f11 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Refreshing network info cache for port b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b7f2a-daa5-4e3d-8469-8f8b4a76f1ba]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe68759-dcf0-4a77-940c-0cb9b76b59d9]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Flushing IO for device /dev/sdf {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.utils [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f403bc47-d634-4147-a266-2f0c0036f93d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a11903-bbcf-4a6c-90aa-f216a8e6cbdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8b17a5-e8ac-4fd0-9683-16832181a096]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7c8bbf-c90a-48f8-a66e-9342be99a2a6]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f8631-26cd-4890-a9c2-2d6cac20d39f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[169924a1-7ccf-4705-bb1f-75bb16775ef6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a0efc8-1533-4c4c-b4c7-b94d6bf3e092]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:29 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d641a-0bba-4101-b31a-3a512758a6ea]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.utils [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3a1e4f-0776-46a0-a858-2232f0098b80]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0, portal: 172.16.0.220,3260]
Aug 26 20:44:29 user nova-compute[73476]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:29 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caf7f5e7-c775-4179-ad9a-3d770b10eef0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce724d22-4cf9-49dc-9332-ea49d824dfb6]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] <== disconnect_volume: return (408ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:44:29 user nova-compute[73476]: INFO nova.compute.manager [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Swapping volume 239a1e48-548c-4773-9dd0-861c4010261c for 592d62f7-8574-4012-81a5-0041153b3872
Aug 26 20:44:29 user nova-compute[73476]: DEBUG nova.network.neutron [req-ef2cb1e3-ac86-423b-a16e-b2e13372443b req-16c54026-f1e2-476a-8b89-aa4fe9eb5f11 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updated VIF entry in instance network info cache for port b51ff675-dbca-4a11-8ed4-a7040a20f850. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG nova.network.neutron [req-ef2cb1e3-ac86-423b-a16e-b2e13372443b req-16c54026-f1e2-476a-8b89-aa4fe9eb5f11 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updating instance_info_cache with network_info: [{"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ef2cb1e3-ac86-423b-a16e-b2e13372443b req-16c54026-f1e2-476a-8b89-aa4fe9eb5f11 service nova] Releasing lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:44:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.objects.instance [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lazy-loading 'flavor' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-58ebe518-d4e7-495e-b9b3-3f5c4f972952 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.218s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "interface-8150e248-6046-4d1e-bb7c-3b94cd6d30e5-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "interface-8150e248-6046-4d1e-bb7c-3b94cd6d30e5-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lazy-loading 'flavor' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309021978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309021978',id=8,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv500ICYQkC8rlDl0rZ7fAGTJyj7kZ3tpS7wPZK0hi+dNo8U4bebGF/MrGe9anTbwaWZhwe37G7Y+gRDfa2LkkTJlaTK44hxXQMKLQOS5XgexamGee3hm5aT5V94z3v7Q==',key_name='tempest-keypair-1352386032',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59d347b5c87b440296fde039405de11d',ramdisk_id='',reservation_id='r-i0hj5l0a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687865165',owner_user_name='tempest-TaggedAttachmentsTest-687865165-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e9f1517b4574f2dbe3def073c65a0c7',uuid=8150e248-6046-4d1e-bb7c-3b94cd6d30e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converting VIF {"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface> {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface> {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Attempting to detach device tap2e1ca6b5-c6 from instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] detach device xml: <interface type="ethernet">
Aug 26 20:44:30 user nova-compute[73476]:   <mac address="fa:16:3e:e2:a5:9b"/>
Aug 26 20:44:30 user nova-compute[73476]:   <model type="virtio"/>
Aug 26 20:44:30 user nova-compute[73476]:   <mtu size="1442"/>
Aug 26 20:44:30 user nova-compute[73476]:   <target dev="tap2e1ca6b5-c6"/>
Aug 26 20:44:30 user nova-compute[73476]: </interface>
Aug 26 20:44:30 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface> {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 26 20:44:30 user nova-compute[73476]:   <name>instance-00000008</name>
Aug 26 20:44:30 user nova-compute[73476]:   <uuid>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</uuid>
Aug 26 20:44:30 user nova-compute[73476]:   <metadata>
Aug 26 20:44:30 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:44:30 user nova-compute[73476]:   <nova:package version="0.0.0"/>
Aug 26 20:44:30 user nova-compute[73476]:   <nova:name>tempest-device-tagging-server-1309021978</nova:name>
Aug 26 20:44:30 user nova-compute[73476]:   <nova:creationTime>2023-08-26 20:44:11</nova:creationTime>
Aug 26 20:44:30 user nova-compute[73476]:   <nova:flavor name="m1.tiny">
Aug 26 20:44:30 user nova-compute[73476]:     <nova:memory>512</nova:memory>
Aug 26 20:44:30 user nova-compute[73476]:     <nova:disk>1</nova:disk>
Aug 26 20:44:30 user nova-compute[73476]:     <nova:swap>0</nova:swap>
Aug 26 20:44:30 user nova-compute[73476]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:44:30 user nova-compute[73476]:     <nova:vcpus>1</nova:vcpus>
Aug 26 20:44:30 user nova-compute[73476]:   </nova:flavor>
Aug 26 20:44:30 user nova-compute[73476]:   <nova:owner>
Aug 26 20:44:30 user nova-compute[73476]:     <nova:user uuid="0e9f1517b4574f2dbe3def073c65a0c7">tempest-TaggedAttachmentsTest-687865165-project-member</nova:user>
Aug 26 20:44:30 user nova-compute[73476]:     <nova:project uuid="59d347b5c87b440296fde039405de11d">tempest-TaggedAttachmentsTest-687865165</nova:project>
Aug 26 20:44:30 user nova-compute[73476]:   </nova:owner>
Aug 26 20:44:30 user nova-compute[73476]:   <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:44:30 user nova-compute[73476]:   <nova:ports>
Aug 26 20:44:30 user nova-compute[73476]:     <nova:port uuid="dc8013cf-f972-4d70-a041-b91ace1b537d">
Aug 26 20:44:30 user nova-compute[73476]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:44:30 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:30 user nova-compute[73476]:     <nova:port uuid="2e1ca6b5-c66e-484d-81ef-6024fa1d52b6">
Aug 26 20:44:30 user nova-compute[73476]:       <nova:ip type="fixed" address="10.10.10.159" ipVersion="4"/>
Aug 26 20:44:30 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:30 user nova-compute[73476]:   </nova:ports>
Aug 26 20:44:30 user nova-compute[73476]: </nova:instance>
Aug 26 20:44:30 user nova-compute[73476]:   </metadata>
Aug 26 20:44:30 user nova-compute[73476]:   <memory unit='KiB'>524288</memory>
Aug 26 20:44:30 user nova-compute[73476]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 20:44:30 user nova-compute[73476]:   <vcpu placement='static'>1</vcpu>
Aug 26 20:44:30 user nova-compute[73476]:   <resource>
Aug 26 20:44:30 user nova-compute[73476]:     <partition>/machine</partition>
Aug 26 20:44:30 user nova-compute[73476]:   </resource>
Aug 26 20:44:30 user nova-compute[73476]:   <sysinfo type='smbios'>
Aug 26 20:44:30 user nova-compute[73476]:     <system>
Aug 26 20:44:30 user nova-compute[73476]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 20:44:30 user nova-compute[73476]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 20:44:30 user nova-compute[73476]:       <entry name='version'>0.0.0</entry>
Aug 26 20:44:30 user nova-compute[73476]:       <entry name='serial'>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:44:30 user nova-compute[73476]:       <entry name='uuid'>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:44:30 user nova-compute[73476]:       <entry name='family'>Virtual Machine</entry>
Aug 26 20:44:30 user nova-compute[73476]:     </system>
Aug 26 20:44:30 user nova-compute[73476]:   </sysinfo>
Aug 26 20:44:30 user nova-compute[73476]:   <os>
Aug 26 20:44:30 user nova-compute[73476]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 20:44:30 user nova-compute[73476]:     <boot dev='hd'/>
Aug 26 20:44:30 user nova-compute[73476]:     <smbios mode='sysinfo'/>
Aug 26 20:44:30 user nova-compute[73476]:   </os>
Aug 26 20:44:30 user nova-compute[73476]:   <features>
Aug 26 20:44:30 user nova-compute[73476]:     <acpi/>
Aug 26 20:44:30 user nova-compute[73476]:     <apic/>
Aug 26 20:44:30 user nova-compute[73476]:     <vmcoreinfo state='on'/>
Aug 26 20:44:30 user nova-compute[73476]:   </features>
Aug 26 20:44:30 user nova-compute[73476]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 20:44:30 user nova-compute[73476]:     <model fallback='forbid'>Nehalem</model>
Aug 26 20:44:30 user nova-compute[73476]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 20:44:30 user nova-compute[73476]:     <feature policy='require' name='vme'/>
Aug 26 20:44:30 user nova-compute[73476]:     <feature policy='require' name='x2apic'/>
Aug 26 20:44:30 user nova-compute[73476]:     <feature policy='require' name='hypervisor'/>
Aug 26 20:44:30 user nova-compute[73476]:   </cpu>
Aug 26 20:44:30 user nova-compute[73476]:   <clock offset='utc'>
Aug 26 20:44:30 user nova-compute[73476]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 20:44:30 user nova-compute[73476]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 20:44:30 user nova-compute[73476]:     <timer name='hpet' present='no'/>
Aug 26 20:44:30 user nova-compute[73476]:   </clock>
Aug 26 20:44:30 user nova-compute[73476]:   <on_poweroff>destroy</on_poweroff>
Aug 26 20:44:30 user nova-compute[73476]:   <on_reboot>restart</on_reboot>
Aug 26 20:44:30 user nova-compute[73476]:   <on_crash>destroy</on_crash>
Aug 26 20:44:30 user nova-compute[73476]:   <devices>
Aug 26 20:44:30 user nova-compute[73476]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 20:44:30 user nova-compute[73476]:     <disk type='file' device='disk'>
Aug 26 20:44:30 user nova-compute[73476]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 20:44:30 user nova-compute[73476]:       <source file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk' index='2'/>
Aug 26 20:44:30 user nova-compute[73476]:       <backingStore type='file' index='3'>
Aug 26 20:44:30 user nova-compute[73476]:         <format type='raw'/>
Aug 26 20:44:30 user nova-compute[73476]:         <source file='/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b'/>
Aug 26 20:44:30 user nova-compute[73476]:         <backingStore/>
Aug 26 20:44:30 user nova-compute[73476]:       </backingStore>
Aug 26 20:44:30 user nova-compute[73476]:       <target dev='vda' bus='virtio'/>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='virtio-disk0'/>
Aug 26 20:44:30 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </disk>
Aug 26 20:44:30 user nova-compute[73476]:     <disk type='file' device='cdrom'>
Aug 26 20:44:30 user nova-compute[73476]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 20:44:30 user nova-compute[73476]:       <source file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.config' index='1'/>
Aug 26 20:44:30 user nova-compute[73476]:       <backingStore/>
Aug 26 20:44:30 user nova-compute[73476]:       <target dev='hda' bus='ide'/>
Aug 26 20:44:30 user nova-compute[73476]:       <readonly/>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='ide0-0-0'/>
Aug 26 20:44:30 user nova-compute[73476]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </disk>
Aug 26 20:44:30 user nova-compute[73476]:     <controller type='usb' index='0' model='none'>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='usb'/>
Aug 26 20:44:30 user nova-compute[73476]:     </controller>
Aug 26 20:44:30 user nova-compute[73476]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='pci.0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </controller>
Aug 26 20:44:30 user nova-compute[73476]:     <controller type='ide' index='0'>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='ide'/>
Aug 26 20:44:30 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 20:44:30 user nova-compute[73476]:     </controller>
Aug 26 20:44:30 user nova-compute[73476]:     <interface type='ethernet'>
Aug 26 20:44:30 user nova-compute[73476]:       <mac address='fa:16:3e:e8:92:f2'/>
Aug 26 20:44:30 user nova-compute[73476]:       <target dev='tapdc8013cf-f9'/>
Aug 26 20:44:30 user nova-compute[73476]:       <model type='virtio'/>
Aug 26 20:44:30 user nova-compute[73476]:       <mtu size='1442'/>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='net0'/>
Aug 26 20:44:30 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </interface>
Aug 26 20:44:30 user nova-compute[73476]:     <interface type='ethernet'>
Aug 26 20:44:30 user nova-compute[73476]:       <mac address='fa:16:3e:e2:a5:9b'/>
Aug 26 20:44:30 user nova-compute[73476]:       <target dev='tap2e1ca6b5-c6'/>
Aug 26 20:44:30 user nova-compute[73476]:       <model type='virtio'/>
Aug 26 20:44:30 user nova-compute[73476]:       <mtu size='1442'/>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='net1'/>
Aug 26 20:44:30 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </interface>
Aug 26 20:44:30 user nova-compute[73476]:     <serial type='pty'>
Aug 26 20:44:30 user nova-compute[73476]:       <source path='/dev/pts/7'/>
Aug 26 20:44:30 user nova-compute[73476]:       <log file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log' append='off'/>
Aug 26 20:44:30 user nova-compute[73476]:       <target type='isa-serial' port='0'>
Aug 26 20:44:30 user nova-compute[73476]:         <model name='isa-serial'/>
Aug 26 20:44:30 user nova-compute[73476]:       </target>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='serial0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </serial>
Aug 26 20:44:30 user nova-compute[73476]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 20:44:30 user nova-compute[73476]:       <source path='/dev/pts/7'/>
Aug 26 20:44:30 user nova-compute[73476]:       <log file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log' append='off'/>
Aug 26 20:44:30 user nova-compute[73476]:       <target type='serial' port='0'/>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='serial0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </console>
Aug 26 20:44:30 user nova-compute[73476]:     <input type='mouse' bus='ps2'>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='input0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </input>
Aug 26 20:44:30 user nova-compute[73476]:     <input type='keyboard' bus='ps2'>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='input1'/>
Aug 26 20:44:30 user nova-compute[73476]:     </input>
Aug 26 20:44:30 user nova-compute[73476]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 20:44:30 user nova-compute[73476]:       <listen type='address' address='0.0.0.0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </graphics>
Aug 26 20:44:30 user nova-compute[73476]:     <audio id='1' type='none'/>
Aug 26 20:44:30 user nova-compute[73476]:     <video>
Aug 26 20:44:30 user nova-compute[73476]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='video0'/>
Aug 26 20:44:30 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </video>
Aug 26 20:44:30 user nova-compute[73476]:     <memballoon model='virtio'>
Aug 26 20:44:30 user nova-compute[73476]:       <stats period='10'/>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='balloon0'/>
Aug 26 20:44:30 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </memballoon>
Aug 26 20:44:30 user nova-compute[73476]:     <rng model='virtio'>
Aug 26 20:44:30 user nova-compute[73476]:       <backend model='random'>/dev/urandom</backend>
Aug 26 20:44:30 user nova-compute[73476]:       <alias name='rng0'/>
Aug 26 20:44:30 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 20:44:30 user nova-compute[73476]:     </rng>
Aug 26 20:44:30 user nova-compute[73476]:   </devices>
Aug 26 20:44:30 user nova-compute[73476]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 20:44:30 user nova-compute[73476]:     <label>libvirt-8150e248-6046-4d1e-bb7c-3b94cd6d30e5</label>
Aug 26 20:44:30 user nova-compute[73476]:     <imagelabel>libvirt-8150e248-6046-4d1e-bb7c-3b94cd6d30e5</imagelabel>
Aug 26 20:44:30 user nova-compute[73476]:   </seclabel>
Aug 26 20:44:30 user nova-compute[73476]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 20:44:30 user nova-compute[73476]:     <label>+64055:+108</label>
Aug 26 20:44:30 user nova-compute[73476]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 20:44:30 user nova-compute[73476]:   </seclabel>
Aug 26 20:44:30 user nova-compute[73476]: </domain>
Aug 26 20:44:30 user nova-compute[73476]:  {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 20:44:30 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Successfully detached device tap2e1ca6b5-c6 from instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 from the persistent domain config.
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] (1/8): Attempting to detach device tap2e1ca6b5-c6 with device alias net1 from instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] detach device xml: <interface type="ethernet">
Aug 26 20:44:30 user nova-compute[73476]:   <mac address="fa:16:3e:e2:a5:9b"/>
Aug 26 20:44:30 user nova-compute[73476]:   <model type="virtio"/>
Aug 26 20:44:30 user nova-compute[73476]:   <mtu size="1442"/>
Aug 26 20:44:30 user nova-compute[73476]:   <target dev="tap2e1ca6b5-c6"/>
Aug 26 20:44:30 user nova-compute[73476]: </interface>
Aug 26 20:44:30 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693082671.092929, 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Start waiting for the detach event from libvirt for device tap2e1ca6b5-c6 with device alias net1 for instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface> {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 26 20:44:31 user nova-compute[73476]:   <name>instance-00000008</name>
Aug 26 20:44:31 user nova-compute[73476]:   <uuid>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</uuid>
Aug 26 20:44:31 user nova-compute[73476]:   <metadata>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:44:31 user nova-compute[73476]:   <nova:package version="0.0.0"/>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:name>tempest-device-tagging-server-1309021978</nova:name>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:creationTime>2023-08-26 20:44:11</nova:creationTime>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:flavor name="m1.tiny">
Aug 26 20:44:31 user nova-compute[73476]:     <nova:memory>512</nova:memory>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:disk>1</nova:disk>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:swap>0</nova:swap>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:vcpus>1</nova:vcpus>
Aug 26 20:44:31 user nova-compute[73476]:   </nova:flavor>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:owner>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:user uuid="0e9f1517b4574f2dbe3def073c65a0c7">tempest-TaggedAttachmentsTest-687865165-project-member</nova:user>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:project uuid="59d347b5c87b440296fde039405de11d">tempest-TaggedAttachmentsTest-687865165</nova:project>
Aug 26 20:44:31 user nova-compute[73476]:   </nova:owner>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:ports>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:port uuid="dc8013cf-f972-4d70-a041-b91ace1b537d">
Aug 26 20:44:31 user nova-compute[73476]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:44:31 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:port uuid="2e1ca6b5-c66e-484d-81ef-6024fa1d52b6">
Aug 26 20:44:31 user nova-compute[73476]:       <nova:ip type="fixed" address="10.10.10.159" ipVersion="4"/>
Aug 26 20:44:31 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:31 user nova-compute[73476]:   </nova:ports>
Aug 26 20:44:31 user nova-compute[73476]: </nova:instance>
Aug 26 20:44:31 user nova-compute[73476]:   </metadata>
Aug 26 20:44:31 user nova-compute[73476]:   <memory unit='KiB'>524288</memory>
Aug 26 20:44:31 user nova-compute[73476]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 20:44:31 user nova-compute[73476]:   <vcpu placement='static'>1</vcpu>
Aug 26 20:44:31 user nova-compute[73476]:   <resource>
Aug 26 20:44:31 user nova-compute[73476]:     <partition>/machine</partition>
Aug 26 20:44:31 user nova-compute[73476]:   </resource>
Aug 26 20:44:31 user nova-compute[73476]:   <sysinfo type='smbios'>
Aug 26 20:44:31 user nova-compute[73476]:     <system>
Aug 26 20:44:31 user nova-compute[73476]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 20:44:31 user nova-compute[73476]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 20:44:31 user nova-compute[73476]:       <entry name='version'>0.0.0</entry>
Aug 26 20:44:31 user nova-compute[73476]:       <entry name='serial'>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:44:31 user nova-compute[73476]:       <entry name='uuid'>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:44:31 user nova-compute[73476]:       <entry name='family'>Virtual Machine</entry>
Aug 26 20:44:31 user nova-compute[73476]:     </system>
Aug 26 20:44:31 user nova-compute[73476]:   </sysinfo>
Aug 26 20:44:31 user nova-compute[73476]:   <os>
Aug 26 20:44:31 user nova-compute[73476]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 20:44:31 user nova-compute[73476]:     <boot dev='hd'/>
Aug 26 20:44:31 user nova-compute[73476]:     <smbios mode='sysinfo'/>
Aug 26 20:44:31 user nova-compute[73476]:   </os>
Aug 26 20:44:31 user nova-compute[73476]:   <features>
Aug 26 20:44:31 user nova-compute[73476]:     <acpi/>
Aug 26 20:44:31 user nova-compute[73476]:     <apic/>
Aug 26 20:44:31 user nova-compute[73476]:     <vmcoreinfo state='on'/>
Aug 26 20:44:31 user nova-compute[73476]:   </features>
Aug 26 20:44:31 user nova-compute[73476]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 20:44:31 user nova-compute[73476]:     <model fallback='forbid'>Nehalem</model>
Aug 26 20:44:31 user nova-compute[73476]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 20:44:31 user nova-compute[73476]:     <feature policy='require' name='vme'/>
Aug 26 20:44:31 user nova-compute[73476]:     <feature policy='require' name='x2apic'/>
Aug 26 20:44:31 user nova-compute[73476]:     <feature policy='require' name='hypervisor'/>
Aug 26 20:44:31 user nova-compute[73476]:   </cpu>
Aug 26 20:44:31 user nova-compute[73476]:   <clock offset='utc'>
Aug 26 20:44:31 user nova-compute[73476]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 20:44:31 user nova-compute[73476]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 20:44:31 user nova-compute[73476]:     <timer name='hpet' present='no'/>
Aug 26 20:44:31 user nova-compute[73476]:   </clock>
Aug 26 20:44:31 user nova-compute[73476]:   <on_poweroff>destroy</on_poweroff>
Aug 26 20:44:31 user nova-compute[73476]:   <on_reboot>restart</on_reboot>
Aug 26 20:44:31 user nova-compute[73476]:   <on_crash>destroy</on_crash>
Aug 26 20:44:31 user nova-compute[73476]:   <devices>
Aug 26 20:44:31 user nova-compute[73476]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 20:44:31 user nova-compute[73476]:     <disk type='file' device='disk'>
Aug 26 20:44:31 user nova-compute[73476]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 20:44:31 user nova-compute[73476]:       <source file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk' index='2'/>
Aug 26 20:44:31 user nova-compute[73476]:       <backingStore type='file' index='3'>
Aug 26 20:44:31 user nova-compute[73476]:         <format type='raw'/>
Aug 26 20:44:31 user nova-compute[73476]:         <source file='/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b'/>
Aug 26 20:44:31 user nova-compute[73476]:         <backingStore/>
Aug 26 20:44:31 user nova-compute[73476]:       </backingStore>
Aug 26 20:44:31 user nova-compute[73476]:       <target dev='vda' bus='virtio'/>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='virtio-disk0'/>
Aug 26 20:44:31 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </disk>
Aug 26 20:44:31 user nova-compute[73476]:     <disk type='file' device='cdrom'>
Aug 26 20:44:31 user nova-compute[73476]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 20:44:31 user nova-compute[73476]:       <source file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.config' index='1'/>
Aug 26 20:44:31 user nova-compute[73476]:       <backingStore/>
Aug 26 20:44:31 user nova-compute[73476]:       <target dev='hda' bus='ide'/>
Aug 26 20:44:31 user nova-compute[73476]:       <readonly/>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='ide0-0-0'/>
Aug 26 20:44:31 user nova-compute[73476]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </disk>
Aug 26 20:44:31 user nova-compute[73476]:     <controller type='usb' index='0' model='none'>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='usb'/>
Aug 26 20:44:31 user nova-compute[73476]:     </controller>
Aug 26 20:44:31 user nova-compute[73476]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='pci.0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </controller>
Aug 26 20:44:31 user nova-compute[73476]:     <controller type='ide' index='0'>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='ide'/>
Aug 26 20:44:31 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 20:44:31 user nova-compute[73476]:     </controller>
Aug 26 20:44:31 user nova-compute[73476]:     <interface type='ethernet'>
Aug 26 20:44:31 user nova-compute[73476]:       <mac address='fa:16:3e:e8:92:f2'/>
Aug 26 20:44:31 user nova-compute[73476]:       <target dev='tapdc8013cf-f9'/>
Aug 26 20:44:31 user nova-compute[73476]:       <model type='virtio'/>
Aug 26 20:44:31 user nova-compute[73476]:       <mtu size='1442'/>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='net0'/>
Aug 26 20:44:31 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </interface>
Aug 26 20:44:31 user nova-compute[73476]:     <serial type='pty'>
Aug 26 20:44:31 user nova-compute[73476]:       <source path='/dev/pts/7'/>
Aug 26 20:44:31 user nova-compute[73476]:       <log file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log' append='off'/>
Aug 26 20:44:31 user nova-compute[73476]:       <target type='isa-serial' port='0'>
Aug 26 20:44:31 user nova-compute[73476]:         <model name='isa-serial'/>
Aug 26 20:44:31 user nova-compute[73476]:       </target>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='serial0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </serial>
Aug 26 20:44:31 user nova-compute[73476]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 20:44:31 user nova-compute[73476]:       <source path='/dev/pts/7'/>
Aug 26 20:44:31 user nova-compute[73476]:       <log file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log' append='off'/>
Aug 26 20:44:31 user nova-compute[73476]:       <target type='serial' port='0'/>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='serial0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </console>
Aug 26 20:44:31 user nova-compute[73476]:     <input type='mouse' bus='ps2'>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='input0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </input>
Aug 26 20:44:31 user nova-compute[73476]:     <input type='keyboard' bus='ps2'>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='input1'/>
Aug 26 20:44:31 user nova-compute[73476]:     </input>
Aug 26 20:44:31 user nova-compute[73476]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 20:44:31 user nova-compute[73476]:       <listen type='address' address='0.0.0.0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </graphics>
Aug 26 20:44:31 user nova-compute[73476]:     <audio id='1' type='none'/>
Aug 26 20:44:31 user nova-compute[73476]:     <video>
Aug 26 20:44:31 user nova-compute[73476]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='video0'/>
Aug 26 20:44:31 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </video>
Aug 26 20:44:31 user nova-compute[73476]:     <memballoon model='virtio'>
Aug 26 20:44:31 user nova-compute[73476]:       <stats period='10'/>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='balloon0'/>
Aug 26 20:44:31 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </memballoon>
Aug 26 20:44:31 user nova-compute[73476]:     <rng model='virtio'>
Aug 26 20:44:31 user nova-compute[73476]:       <backend model='random'>/dev/urandom</backend>
Aug 26 20:44:31 user nova-compute[73476]:       <alias name='rng0'/>
Aug 26 20:44:31 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 20:44:31 user nova-compute[73476]:     </rng>
Aug 26 20:44:31 user nova-compute[73476]:   </devices>
Aug 26 20:44:31 user nova-compute[73476]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 20:44:31 user nova-compute[73476]:     <label>libvirt-8150e248-6046-4d1e-bb7c-3b94cd6d30e5</label>
Aug 26 20:44:31 user nova-compute[73476]:     <imagelabel>libvirt-8150e248-6046-4d1e-bb7c-3b94cd6d30e5</imagelabel>
Aug 26 20:44:31 user nova-compute[73476]:   </seclabel>
Aug 26 20:44:31 user nova-compute[73476]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 20:44:31 user nova-compute[73476]:     <label>+64055:+108</label>
Aug 26 20:44:31 user nova-compute[73476]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 20:44:31 user nova-compute[73476]:   </seclabel>
Aug 26 20:44:31 user nova-compute[73476]: </domain>
Aug 26 20:44:31 user nova-compute[73476]:  {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 20:44:31 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Successfully detached device tap2e1ca6b5-c6 from instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 from the live domain config.
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309021978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309021978',id=8,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv500ICYQkC8rlDl0rZ7fAGTJyj7kZ3tpS7wPZK0hi+dNo8U4bebGF/MrGe9anTbwaWZhwe37G7Y+gRDfa2LkkTJlaTK44hxXQMKLQOS5XgexamGee3hm5aT5V94z3v7Q==',key_name='tempest-keypair-1352386032',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59d347b5c87b440296fde039405de11d',ramdisk_id='',reservation_id='r-i0hj5l0a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687865165',owner_user_name='tempest-TaggedAttachmentsTest-687865165-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e9f1517b4574f2dbe3def073c65a0c7',uuid=8150e248-6046-4d1e-bb7c-3b94cd6d30e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converting VIF {"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_vif [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e1ca6b5-c6, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:31 user nova-compute[73476]: INFO os_vif [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6')
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:44:31 user nova-compute[73476]:   <nova:package version="0.0.0"/>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:name>tempest-device-tagging-server-1309021978</nova:name>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:creationTime>2023-08-26 20:44:31</nova:creationTime>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:flavor name="m1.tiny">
Aug 26 20:44:31 user nova-compute[73476]:     <nova:memory>512</nova:memory>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:disk>1</nova:disk>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:swap>0</nova:swap>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:vcpus>1</nova:vcpus>
Aug 26 20:44:31 user nova-compute[73476]:   </nova:flavor>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:owner>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:user uuid="0e9f1517b4574f2dbe3def073c65a0c7">tempest-TaggedAttachmentsTest-687865165-project-member</nova:user>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:project uuid="59d347b5c87b440296fde039405de11d">tempest-TaggedAttachmentsTest-687865165</nova:project>
Aug 26 20:44:31 user nova-compute[73476]:   </nova:owner>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:44:31 user nova-compute[73476]:   <nova:ports>
Aug 26 20:44:31 user nova-compute[73476]:     <nova:port uuid="dc8013cf-f972-4d70-a041-b91ace1b537d">
Aug 26 20:44:31 user nova-compute[73476]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:44:31 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:31 user nova-compute[73476]:   </nova:ports>
Aug 26 20:44:31 user nova-compute[73476]: </nova:instance>
Aug 26 20:44:31 user nova-compute[73476]:  {{(pid=73476) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHIyWLkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:31 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:31 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:31 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7dfcb6-3c87-4758-a5c3-be0edcf75986]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:44:31 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d007229-462d-4d47-97a3-65f70b122db7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c] added
Aug 26 20:44:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bec1448-d168-4854-b978-0ff4f195bd52]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c88bd1c-bb87-40fe-b767-deff47deecc7]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHIyWLkZ {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHIyWLkZ" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7906e8b-a7d8-488a-a93b-2dcbf44913df]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qHIyWLkZ'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1fcef7-fc9f-4e6f-9ed7-1c092640f7ca]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13ecb8b-a166-417b-b1ce-1e391cb4231a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.compute.manager [req-20bf2ead-c433-4219-9075-c7a332bd620d req-fffcc190-300c-4366-a4b8-36a673560d74 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-unplugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-20bf2ead-c433-4219-9075-c7a332bd620d req-fffcc190-300c-4366-a4b8-36a673560d74 service nova] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-20bf2ead-c433-4219-9075-c7a332bd620d req-fffcc190-300c-4366-a4b8-36a673560d74 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-20bf2ead-c433-4219-9075-c7a332bd620d req-fffcc190-300c-4366-a4b8-36a673560d74 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.compute.manager [req-20bf2ead-c433-4219-9075-c7a332bd620d req-fffcc190-300c-4366-a4b8-36a673560d74 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] No waiting events found dispatching network-vif-unplugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:31 user nova-compute[73476]: WARNING nova.compute.manager [req-20bf2ead-c433-4219-9075-c7a332bd620d req-fffcc190-300c-4366-a4b8-36a673560d74 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received unexpected event network-vif-unplugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 for instance with vm_state active and task_state None.
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1355fe2-4064-475e-8bc1-473bfd832c1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c, portal: 172.16.0.220,3260]
Aug 26 20:44:31 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e050c25-3143-48f4-8496-866868b6b165]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd79e28-ecdb-41d1-8913-4b1d0e7dc53f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:31 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6b0fc7-6793-477f-979a-6938ecdcd013]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHIyWLkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.compute.manager [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-deleted-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:31 user nova-compute[73476]: INFO nova.compute.manager [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Neutron deleted interface 2e1ca6b5-c66e-484d-81ef-6024fa1d52b6; detaching it from the instance and deleting it from the info cache
Aug 26 20:44:31 user nova-compute[73476]: DEBUG nova.network.neutron [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating instance_info_cache with network_info: [{"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.objects.instance [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] Lazy-loading 'system_metadata' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquired lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.objects.instance [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] Lazy-loading 'flavor' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.objects.base [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] Object Instance<8150e248-6046-4d1e-bb7c-3b94cd6d30e5> lazy-loaded attributes: system_metadata,flavor {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309021978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309021978',id=8,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv500ICYQkC8rlDl0rZ7fAGTJyj7kZ3tpS7wPZK0hi+dNo8U4bebGF/MrGe9anTbwaWZhwe37G7Y+gRDfa2LkkTJlaTK44hxXQMKLQOS5XgexamGee3hm5aT5V94z3v7Q==',key_name='tempest-keypair-1352386032',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59d347b5c87b440296fde039405de11d',ramdisk_id='',reservation_id='r-i0hj5l0a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687865165',owner_user_name='tempest-TaggedAttachmentsTest-687865165-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e9f1517b4574f2dbe3def073c65a0c7',uuid=8150e248-6046-4d1e-bb7c-3b94cd6d30e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.network.os_vif_util [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] Converting VIF {"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.network.os_vif_util [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface> {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 26 20:44:32 user nova-compute[73476]:   <name>instance-00000008</name>
Aug 26 20:44:32 user nova-compute[73476]:   <uuid>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</uuid>
Aug 26 20:44:32 user nova-compute[73476]:   <metadata>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:44:32 user nova-compute[73476]:   <nova:package version="0.0.0"/>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:name>tempest-device-tagging-server-1309021978</nova:name>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:creationTime>2023-08-26 20:44:31</nova:creationTime>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:flavor name="m1.tiny">
Aug 26 20:44:32 user nova-compute[73476]:     <nova:memory>512</nova:memory>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:disk>1</nova:disk>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:swap>0</nova:swap>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:vcpus>1</nova:vcpus>
Aug 26 20:44:32 user nova-compute[73476]:   </nova:flavor>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:owner>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:user uuid="0e9f1517b4574f2dbe3def073c65a0c7">tempest-TaggedAttachmentsTest-687865165-project-member</nova:user>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:project uuid="59d347b5c87b440296fde039405de11d">tempest-TaggedAttachmentsTest-687865165</nova:project>
Aug 26 20:44:32 user nova-compute[73476]:   </nova:owner>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:ports>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:port uuid="dc8013cf-f972-4d70-a041-b91ace1b537d">
Aug 26 20:44:32 user nova-compute[73476]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:44:32 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:32 user nova-compute[73476]:   </nova:ports>
Aug 26 20:44:32 user nova-compute[73476]: </nova:instance>
Aug 26 20:44:32 user nova-compute[73476]:   </metadata>
Aug 26 20:44:32 user nova-compute[73476]:   <memory unit='KiB'>524288</memory>
Aug 26 20:44:32 user nova-compute[73476]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 20:44:32 user nova-compute[73476]:   <vcpu placement='static'>1</vcpu>
Aug 26 20:44:32 user nova-compute[73476]:   <resource>
Aug 26 20:44:32 user nova-compute[73476]:     <partition>/machine</partition>
Aug 26 20:44:32 user nova-compute[73476]:   </resource>
Aug 26 20:44:32 user nova-compute[73476]:   <sysinfo type='smbios'>
Aug 26 20:44:32 user nova-compute[73476]:     <system>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='version'>0.0.0</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='serial'>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='uuid'>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='family'>Virtual Machine</entry>
Aug 26 20:44:32 user nova-compute[73476]:     </system>
Aug 26 20:44:32 user nova-compute[73476]:   </sysinfo>
Aug 26 20:44:32 user nova-compute[73476]:   <os>
Aug 26 20:44:32 user nova-compute[73476]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 20:44:32 user nova-compute[73476]:     <boot dev='hd'/>
Aug 26 20:44:32 user nova-compute[73476]:     <smbios mode='sysinfo'/>
Aug 26 20:44:32 user nova-compute[73476]:   </os>
Aug 26 20:44:32 user nova-compute[73476]:   <features>
Aug 26 20:44:32 user nova-compute[73476]:     <acpi/>
Aug 26 20:44:32 user nova-compute[73476]:     <apic/>
Aug 26 20:44:32 user nova-compute[73476]:     <vmcoreinfo state='on'/>
Aug 26 20:44:32 user nova-compute[73476]:   </features>
Aug 26 20:44:32 user nova-compute[73476]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 20:44:32 user nova-compute[73476]:     <model fallback='forbid'>Nehalem</model>
Aug 26 20:44:32 user nova-compute[73476]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 20:44:32 user nova-compute[73476]:     <feature policy='require' name='vme'/>
Aug 26 20:44:32 user nova-compute[73476]:     <feature policy='require' name='x2apic'/>
Aug 26 20:44:32 user nova-compute[73476]:     <feature policy='require' name='hypervisor'/>
Aug 26 20:44:32 user nova-compute[73476]:   </cpu>
Aug 26 20:44:32 user nova-compute[73476]:   <clock offset='utc'>
Aug 26 20:44:32 user nova-compute[73476]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 20:44:32 user nova-compute[73476]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 20:44:32 user nova-compute[73476]:     <timer name='hpet' present='no'/>
Aug 26 20:44:32 user nova-compute[73476]:   </clock>
Aug 26 20:44:32 user nova-compute[73476]:   <on_poweroff>destroy</on_poweroff>
Aug 26 20:44:32 user nova-compute[73476]:   <on_reboot>restart</on_reboot>
Aug 26 20:44:32 user nova-compute[73476]:   <on_crash>destroy</on_crash>
Aug 26 20:44:32 user nova-compute[73476]:   <devices>
Aug 26 20:44:32 user nova-compute[73476]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 20:44:32 user nova-compute[73476]:     <disk type='file' device='disk'>
Aug 26 20:44:32 user nova-compute[73476]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 20:44:32 user nova-compute[73476]:       <source file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk' index='2'/>
Aug 26 20:44:32 user nova-compute[73476]:       <backingStore type='file' index='3'>
Aug 26 20:44:32 user nova-compute[73476]:         <format type='raw'/>
Aug 26 20:44:32 user nova-compute[73476]:         <source file='/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b'/>
Aug 26 20:44:32 user nova-compute[73476]:         <backingStore/>
Aug 26 20:44:32 user nova-compute[73476]:       </backingStore>
Aug 26 20:44:32 user nova-compute[73476]:       <target dev='vda' bus='virtio'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='virtio-disk0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </disk>
Aug 26 20:44:32 user nova-compute[73476]:     <disk type='file' device='cdrom'>
Aug 26 20:44:32 user nova-compute[73476]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 20:44:32 user nova-compute[73476]:       <source file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.config' index='1'/>
Aug 26 20:44:32 user nova-compute[73476]:       <backingStore/>
Aug 26 20:44:32 user nova-compute[73476]:       <target dev='hda' bus='ide'/>
Aug 26 20:44:32 user nova-compute[73476]:       <readonly/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='ide0-0-0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </disk>
Aug 26 20:44:32 user nova-compute[73476]:     <controller type='usb' index='0' model='none'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='usb'/>
Aug 26 20:44:32 user nova-compute[73476]:     </controller>
Aug 26 20:44:32 user nova-compute[73476]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='pci.0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </controller>
Aug 26 20:44:32 user nova-compute[73476]:     <controller type='ide' index='0'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='ide'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 20:44:32 user nova-compute[73476]:     </controller>
Aug 26 20:44:32 user nova-compute[73476]:     <interface type='ethernet'>
Aug 26 20:44:32 user nova-compute[73476]:       <mac address='fa:16:3e:e8:92:f2'/>
Aug 26 20:44:32 user nova-compute[73476]:       <target dev='tapdc8013cf-f9'/>
Aug 26 20:44:32 user nova-compute[73476]:       <model type='virtio'/>
Aug 26 20:44:32 user nova-compute[73476]:       <mtu size='1442'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='net0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </interface>
Aug 26 20:44:32 user nova-compute[73476]:     <serial type='pty'>
Aug 26 20:44:32 user nova-compute[73476]:       <source path='/dev/pts/7'/>
Aug 26 20:44:32 user nova-compute[73476]:       <log file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log' append='off'/>
Aug 26 20:44:32 user nova-compute[73476]:       <target type='isa-serial' port='0'>
Aug 26 20:44:32 user nova-compute[73476]:         <model name='isa-serial'/>
Aug 26 20:44:32 user nova-compute[73476]:       </target>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='serial0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </serial>
Aug 26 20:44:32 user nova-compute[73476]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 20:44:32 user nova-compute[73476]:       <source path='/dev/pts/7'/>
Aug 26 20:44:32 user nova-compute[73476]:       <log file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log' append='off'/>
Aug 26 20:44:32 user nova-compute[73476]:       <target type='serial' port='0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='serial0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </console>
Aug 26 20:44:32 user nova-compute[73476]:     <input type='mouse' bus='ps2'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='input0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </input>
Aug 26 20:44:32 user nova-compute[73476]:     <input type='keyboard' bus='ps2'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='input1'/>
Aug 26 20:44:32 user nova-compute[73476]:     </input>
Aug 26 20:44:32 user nova-compute[73476]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 20:44:32 user nova-compute[73476]:       <listen type='address' address='0.0.0.0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </graphics>
Aug 26 20:44:32 user nova-compute[73476]:     <audio id='1' type='none'/>
Aug 26 20:44:32 user nova-compute[73476]:     <video>
Aug 26 20:44:32 user nova-compute[73476]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='video0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </video>
Aug 26 20:44:32 user nova-compute[73476]:     <memballoon model='virtio'>
Aug 26 20:44:32 user nova-compute[73476]:       <stats period='10'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='balloon0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </memballoon>
Aug 26 20:44:32 user nova-compute[73476]:     <rng model='virtio'>
Aug 26 20:44:32 user nova-compute[73476]:       <backend model='random'>/dev/urandom</backend>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='rng0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </rng>
Aug 26 20:44:32 user nova-compute[73476]:   </devices>
Aug 26 20:44:32 user nova-compute[73476]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 20:44:32 user nova-compute[73476]:     <label>libvirt-8150e248-6046-4d1e-bb7c-3b94cd6d30e5</label>
Aug 26 20:44:32 user nova-compute[73476]:     <imagelabel>libvirt-8150e248-6046-4d1e-bb7c-3b94cd6d30e5</imagelabel>
Aug 26 20:44:32 user nova-compute[73476]:   </seclabel>
Aug 26 20:44:32 user nova-compute[73476]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 20:44:32 user nova-compute[73476]:     <label>+64055:+108</label>
Aug 26 20:44:32 user nova-compute[73476]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 20:44:32 user nova-compute[73476]:   </seclabel>
Aug 26 20:44:32 user nova-compute[73476]: </domain>
Aug 26 20:44:32 user nova-compute[73476]:  {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface> {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e2:a5:9b"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e1ca6b5-c6"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 26 20:44:32 user nova-compute[73476]:   <name>instance-00000008</name>
Aug 26 20:44:32 user nova-compute[73476]:   <uuid>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</uuid>
Aug 26 20:44:32 user nova-compute[73476]:   <metadata>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:44:32 user nova-compute[73476]:   <nova:package version="0.0.0"/>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:name>tempest-device-tagging-server-1309021978</nova:name>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:creationTime>2023-08-26 20:44:31</nova:creationTime>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:flavor name="m1.tiny">
Aug 26 20:44:32 user nova-compute[73476]:     <nova:memory>512</nova:memory>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:disk>1</nova:disk>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:swap>0</nova:swap>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:vcpus>1</nova:vcpus>
Aug 26 20:44:32 user nova-compute[73476]:   </nova:flavor>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:owner>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:user uuid="0e9f1517b4574f2dbe3def073c65a0c7">tempest-TaggedAttachmentsTest-687865165-project-member</nova:user>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:project uuid="59d347b5c87b440296fde039405de11d">tempest-TaggedAttachmentsTest-687865165</nova:project>
Aug 26 20:44:32 user nova-compute[73476]:   </nova:owner>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:ports>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:port uuid="dc8013cf-f972-4d70-a041-b91ace1b537d">
Aug 26 20:44:32 user nova-compute[73476]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:44:32 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:32 user nova-compute[73476]:   </nova:ports>
Aug 26 20:44:32 user nova-compute[73476]: </nova:instance>
Aug 26 20:44:32 user nova-compute[73476]:   </metadata>
Aug 26 20:44:32 user nova-compute[73476]:   <memory unit='KiB'>524288</memory>
Aug 26 20:44:32 user nova-compute[73476]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 20:44:32 user nova-compute[73476]:   <vcpu placement='static'>1</vcpu>
Aug 26 20:44:32 user nova-compute[73476]:   <resource>
Aug 26 20:44:32 user nova-compute[73476]:     <partition>/machine</partition>
Aug 26 20:44:32 user nova-compute[73476]:   </resource>
Aug 26 20:44:32 user nova-compute[73476]:   <sysinfo type='smbios'>
Aug 26 20:44:32 user nova-compute[73476]:     <system>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='version'>0.0.0</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='serial'>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='uuid'>8150e248-6046-4d1e-bb7c-3b94cd6d30e5</entry>
Aug 26 20:44:32 user nova-compute[73476]:       <entry name='family'>Virtual Machine</entry>
Aug 26 20:44:32 user nova-compute[73476]:     </system>
Aug 26 20:44:32 user nova-compute[73476]:   </sysinfo>
Aug 26 20:44:32 user nova-compute[73476]:   <os>
Aug 26 20:44:32 user nova-compute[73476]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 20:44:32 user nova-compute[73476]:     <boot dev='hd'/>
Aug 26 20:44:32 user nova-compute[73476]:     <smbios mode='sysinfo'/>
Aug 26 20:44:32 user nova-compute[73476]:   </os>
Aug 26 20:44:32 user nova-compute[73476]:   <features>
Aug 26 20:44:32 user nova-compute[73476]:     <acpi/>
Aug 26 20:44:32 user nova-compute[73476]:     <apic/>
Aug 26 20:44:32 user nova-compute[73476]:     <vmcoreinfo state='on'/>
Aug 26 20:44:32 user nova-compute[73476]:   </features>
Aug 26 20:44:32 user nova-compute[73476]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 20:44:32 user nova-compute[73476]:     <model fallback='forbid'>Nehalem</model>
Aug 26 20:44:32 user nova-compute[73476]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 20:44:32 user nova-compute[73476]:     <feature policy='require' name='vme'/>
Aug 26 20:44:32 user nova-compute[73476]:     <feature policy='require' name='x2apic'/>
Aug 26 20:44:32 user nova-compute[73476]:     <feature policy='require' name='hypervisor'/>
Aug 26 20:44:32 user nova-compute[73476]:   </cpu>
Aug 26 20:44:32 user nova-compute[73476]:   <clock offset='utc'>
Aug 26 20:44:32 user nova-compute[73476]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 20:44:32 user nova-compute[73476]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 20:44:32 user nova-compute[73476]:     <timer name='hpet' present='no'/>
Aug 26 20:44:32 user nova-compute[73476]:   </clock>
Aug 26 20:44:32 user nova-compute[73476]:   <on_poweroff>destroy</on_poweroff>
Aug 26 20:44:32 user nova-compute[73476]:   <on_reboot>restart</on_reboot>
Aug 26 20:44:32 user nova-compute[73476]:   <on_crash>destroy</on_crash>
Aug 26 20:44:32 user nova-compute[73476]:   <devices>
Aug 26 20:44:32 user nova-compute[73476]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 20:44:32 user nova-compute[73476]:     <disk type='file' device='disk'>
Aug 26 20:44:32 user nova-compute[73476]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 20:44:32 user nova-compute[73476]:       <source file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk' index='2'/>
Aug 26 20:44:32 user nova-compute[73476]:       <backingStore type='file' index='3'>
Aug 26 20:44:32 user nova-compute[73476]:         <format type='raw'/>
Aug 26 20:44:32 user nova-compute[73476]:         <source file='/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b'/>
Aug 26 20:44:32 user nova-compute[73476]:         <backingStore/>
Aug 26 20:44:32 user nova-compute[73476]:       </backingStore>
Aug 26 20:44:32 user nova-compute[73476]:       <target dev='vda' bus='virtio'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='virtio-disk0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </disk>
Aug 26 20:44:32 user nova-compute[73476]:     <disk type='file' device='cdrom'>
Aug 26 20:44:32 user nova-compute[73476]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 20:44:32 user nova-compute[73476]:       <source file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk.config' index='1'/>
Aug 26 20:44:32 user nova-compute[73476]:       <backingStore/>
Aug 26 20:44:32 user nova-compute[73476]:       <target dev='hda' bus='ide'/>
Aug 26 20:44:32 user nova-compute[73476]:       <readonly/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='ide0-0-0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </disk>
Aug 26 20:44:32 user nova-compute[73476]:     <controller type='usb' index='0' model='none'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='usb'/>
Aug 26 20:44:32 user nova-compute[73476]:     </controller>
Aug 26 20:44:32 user nova-compute[73476]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='pci.0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </controller>
Aug 26 20:44:32 user nova-compute[73476]:     <controller type='ide' index='0'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='ide'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 20:44:32 user nova-compute[73476]:     </controller>
Aug 26 20:44:32 user nova-compute[73476]:     <interface type='ethernet'>
Aug 26 20:44:32 user nova-compute[73476]:       <mac address='fa:16:3e:e8:92:f2'/>
Aug 26 20:44:32 user nova-compute[73476]:       <target dev='tapdc8013cf-f9'/>
Aug 26 20:44:32 user nova-compute[73476]:       <model type='virtio'/>
Aug 26 20:44:32 user nova-compute[73476]:       <mtu size='1442'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='net0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </interface>
Aug 26 20:44:32 user nova-compute[73476]:     <serial type='pty'>
Aug 26 20:44:32 user nova-compute[73476]:       <source path='/dev/pts/7'/>
Aug 26 20:44:32 user nova-compute[73476]:       <log file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log' append='off'/>
Aug 26 20:44:32 user nova-compute[73476]:       <target type='isa-serial' port='0'>
Aug 26 20:44:32 user nova-compute[73476]:         <model name='isa-serial'/>
Aug 26 20:44:32 user nova-compute[73476]:       </target>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='serial0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </serial>
Aug 26 20:44:32 user nova-compute[73476]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 20:44:32 user nova-compute[73476]:       <source path='/dev/pts/7'/>
Aug 26 20:44:32 user nova-compute[73476]:       <log file='/opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/console.log' append='off'/>
Aug 26 20:44:32 user nova-compute[73476]:       <target type='serial' port='0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='serial0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </console>
Aug 26 20:44:32 user nova-compute[73476]:     <input type='mouse' bus='ps2'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='input0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </input>
Aug 26 20:44:32 user nova-compute[73476]:     <input type='keyboard' bus='ps2'>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='input1'/>
Aug 26 20:44:32 user nova-compute[73476]:     </input>
Aug 26 20:44:32 user nova-compute[73476]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 20:44:32 user nova-compute[73476]:       <listen type='address' address='0.0.0.0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </graphics>
Aug 26 20:44:32 user nova-compute[73476]:     <audio id='1' type='none'/>
Aug 26 20:44:32 user nova-compute[73476]:     <video>
Aug 26 20:44:32 user nova-compute[73476]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='video0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </video>
Aug 26 20:44:32 user nova-compute[73476]:     <memballoon model='virtio'>
Aug 26 20:44:32 user nova-compute[73476]:       <stats period='10'/>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='balloon0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </memballoon>
Aug 26 20:44:32 user nova-compute[73476]:     <rng model='virtio'>
Aug 26 20:44:32 user nova-compute[73476]:       <backend model='random'>/dev/urandom</backend>
Aug 26 20:44:32 user nova-compute[73476]:       <alias name='rng0'/>
Aug 26 20:44:32 user nova-compute[73476]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 20:44:32 user nova-compute[73476]:     </rng>
Aug 26 20:44:32 user nova-compute[73476]:   </devices>
Aug 26 20:44:32 user nova-compute[73476]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 20:44:32 user nova-compute[73476]:     <label>libvirt-8150e248-6046-4d1e-bb7c-3b94cd6d30e5</label>
Aug 26 20:44:32 user nova-compute[73476]:     <imagelabel>libvirt-8150e248-6046-4d1e-bb7c-3b94cd6d30e5</imagelabel>
Aug 26 20:44:32 user nova-compute[73476]:   </seclabel>
Aug 26 20:44:32 user nova-compute[73476]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 20:44:32 user nova-compute[73476]:     <label>+64055:+108</label>
Aug 26 20:44:32 user nova-compute[73476]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 20:44:32 user nova-compute[73476]:   </seclabel>
Aug 26 20:44:32 user nova-compute[73476]: </domain>
Aug 26 20:44:32 user nova-compute[73476]:  {{(pid=73476) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 20:44:32 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Detaching interface fa:16:3e:e2:a5:9b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2e1ca6b5-c6' not found.
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309021978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309021978',id=8,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv500ICYQkC8rlDl0rZ7fAGTJyj7kZ3tpS7wPZK0hi+dNo8U4bebGF/MrGe9anTbwaWZhwe37G7Y+gRDfa2LkkTJlaTK44hxXQMKLQOS5XgexamGee3hm5aT5V94z3v7Q==',key_name='tempest-keypair-1352386032',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59d347b5c87b440296fde039405de11d',ramdisk_id='',reservation_id='r-i0hj5l0a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687865165',owner_user_name='tempest-TaggedAttachmentsTest-687865165-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e9f1517b4574f2dbe3def073c65a0c7',uuid=8150e248-6046-4d1e-bb7c-3b94cd6d30e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.network.os_vif_util [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] Converting VIF {"id": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "address": "fa:16:3e:e2:a5:9b", "network": {"id": "c7d90756-0146-45ce-b9d6-4c6c71d62e72", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-327871501", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1ca6b5-c6", "ovs_interfaceid": "2e1ca6b5-c66e-484d-81ef-6024fa1d52b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.network.os_vif_util [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG os_vif [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e1ca6b5-c6, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:44:32 user nova-compute[73476]: INFO os_vif [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:a5:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e1ca6b5-c66e-484d-81ef-6024fa1d52b6,network=Network(c7d90756-0146-45ce-b9d6-4c6c71d62e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1ca6b5-c6')
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [req-ffd52e8c-21ad-4059-aa79-7c8a14e7b4d6 req-fba764e1-99e4-4f61-9f6e-0f0f43194c85 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:44:32 user nova-compute[73476]:   <nova:package version="0.0.0"/>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:name>tempest-device-tagging-server-1309021978</nova:name>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:creationTime>2023-08-26 20:44:32</nova:creationTime>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:flavor name="m1.tiny">
Aug 26 20:44:32 user nova-compute[73476]:     <nova:memory>512</nova:memory>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:disk>1</nova:disk>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:swap>0</nova:swap>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:vcpus>1</nova:vcpus>
Aug 26 20:44:32 user nova-compute[73476]:   </nova:flavor>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:owner>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:user uuid="0e9f1517b4574f2dbe3def073c65a0c7">tempest-TaggedAttachmentsTest-687865165-project-member</nova:user>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:project uuid="59d347b5c87b440296fde039405de11d">tempest-TaggedAttachmentsTest-687865165</nova:project>
Aug 26 20:44:32 user nova-compute[73476]:   </nova:owner>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:44:32 user nova-compute[73476]:   <nova:ports>
Aug 26 20:44:32 user nova-compute[73476]:     <nova:port uuid="dc8013cf-f972-4d70-a041-b91ace1b537d">
Aug 26 20:44:32 user nova-compute[73476]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:44:32 user nova-compute[73476]:     </nova:port>
Aug 26 20:44:32 user nova-compute[73476]:   </nova:ports>
Aug 26 20:44:32 user nova-compute[73476]: </nova:instance>
Aug 26 20:44:32 user nova-compute[73476]:  {{(pid=73476) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG os_brick.utils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[90983d57-8edd-4544-912a-55cb5f0486bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[114504ea-852a-4c6e-bd9f-1e60fa97b3c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c960377-f508-49d0-95b3-837cce03c106]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac72d9f-bf7b-44fd-a7df-f3863168fbdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:32 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fead18-1ae6-42f4-b603-2efb5d18f13d]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG os_brick.utils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updating existing volume attachment record: 90d03a89-a09e-4f58-b8d6-58375ecd8142 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating instance_info_cache with network_info: [{"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Releasing lock "refresh_cache-8150e248-6046-4d1e-bb7c-3b94cd6d30e5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cc771956-4762-4764-8260-3a3d3d292bae tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "interface-8150e248-6046-4d1e-bb7c-3b94cd6d30e5-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.059s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.514s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] <== connect_volume: return (1519ms) {'type': 'block', 'scsi_wwn': '23835376639623636', 'path': '/dev/sdh'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835376639623636', 'path': '/dev/sdh'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lazy-loading 'flavor' on Instance uuid ee7cf32f-71c2-49ca-8a23-51fc95560974 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 20:44:32 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:32 user nova-compute[73476]:   <source dev="/dev/sdh"/>
Aug 26 20:44:32 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:32 user nova-compute[73476]:   <serial>6ce1022b-a6a3-4652-95ca-93f280ebeb2c</serial>
Aug 26 20:44:32 user nova-compute[73476]: </disk>
Aug 26 20:44:32 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] No VIF found with MAC fa:16:3e:e3:98:32, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9a87b3cf-d890-4a4d-9381-a99e3cdac8a6 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.643s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-c79685f8-a242-4a11-aed4-63896937dc51 req-4548e214-9d19-488b-a98b-3e0d61920c20 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-plugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c79685f8-a242-4a11-aed4-63896937dc51 req-4548e214-9d19-488b-a98b-3e0d61920c20 service nova] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c79685f8-a242-4a11-aed4-63896937dc51 req-4548e214-9d19-488b-a98b-3e0d61920c20 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c79685f8-a242-4a11-aed4-63896937dc51 req-4548e214-9d19-488b-a98b-3e0d61920c20 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-c79685f8-a242-4a11-aed4-63896937dc51 req-4548e214-9d19-488b-a98b-3e0d61920c20 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] No waiting events found dispatching network-vif-plugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:33 user nova-compute[73476]: WARNING nova.compute.manager [req-c79685f8-a242-4a11-aed4-63896937dc51 req-4548e214-9d19-488b-a98b-3e0d61920c20 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received unexpected event network-vif-plugged-2e1ca6b5-c66e-484d-81ef-6024fa1d52b6 for instance with vm_state active and task_state None.
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ddeaae70-5819-4490-8da4-0dbba482b8d3 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] volume_snapshot_create: create_info: {'snapshot_id': '6eed6a7e-3fae-4a4b-a026-ef39d2b66c77', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73476) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 20:44:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ddeaae70-5819-4490-8da4-0dbba482b8d3 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] snap xml: <domainsnapshot>
Aug 26 20:44:34 user nova-compute[73476]:   <disks>
Aug 26 20:44:34 user nova-compute[73476]:     <disk name="/dev/sdh" snapshot="external" type="file">
Aug 26 20:44:34 user nova-compute[73476]:       <source file="/dev/new_file"/>
Aug 26 20:44:34 user nova-compute[73476]:     </disk>
Aug 26 20:44:34 user nova-compute[73476]:     <disk name="vda" snapshot="no"/>
Aug 26 20:44:34 user nova-compute[73476]:   </disks>
Aug 26 20:44:34 user nova-compute[73476]: </domainsnapshot>
Aug 26 20:44:34 user nova-compute[73476]:  {{(pid=73476) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 20:44:34 user nova-compute[73476]: DEBUG nova.objects.instance [None req-ddeaae70-5819-4490-8da4-0dbba482b8d3 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] Lazy-loading 'system_metadata' on Instance uuid ee7cf32f-71c2-49ca-8a23-51fc95560974 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f6530c0b-6afd-49f2-a80e-d833a6116db9 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] volume_snapshot_delete: delete_info: {'volume_id': '6ce1022b-a6a3-4652-95ca-93f280ebeb2c'} {{(pid=73476) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [None req-f6530c0b-6afd-49f2-a80e-d833a6116db9 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     if delete_info['type'] != 'qcow2':
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] KeyError: 'type'
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] 
Aug 26 20:44:34 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ddeaae70-5819-4490-8da4-0dbba482b8d3 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [None req-ddeaae70-5819-4490-8da4-0dbba482b8d3 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     rv = execute(f, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     six.reraise(c, e, tb)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     raise value
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     rv = meth(*args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [None req-ddeaae70-5819-4490-8da4-0dbba482b8d3 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     self._volume_snapshot_create(context, instance, guest,
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     rv = execute(f, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     six.reraise(c, e, tb)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     raise value
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     rv = meth(*args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [None req-f6530c0b-6afd-49f2-a80e-d833a6116db9 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-143c28d5-429c-45ad-aaa3-d86ac3baf36d)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server [None req-f6530c0b-6afd-49f2-a80e-d833a6116db9 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] Exception during message handling: KeyError: 'type'
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server 
Aug 26 20:44:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver [None req-ddeaae70-5819-4490-8da4-0dbba482b8d3 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6eed6a7e-3fae-4a4b-a026-ef39d2b66c77 could not be found.
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6eed6a7e-3fae-4a4b-a026-ef39d2b66c77 could not be found. (HTTP 404) (Request-ID: req-d1104c9c-1504-42e4-b52f-c5e0800f21ab)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6eed6a7e-3fae-4a4b-a026-ef39d2b66c77 could not be found.
Aug 26 20:44:34 user nova-compute[73476]: ERROR nova.virt.libvirt.driver 
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server [None req-ddeaae70-5819-4490-8da4-0dbba482b8d3 tempest-VolumesAssistedSnapshotsTest-760992956 tempest-VolumesAssistedSnapshotsTest-760992956-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 20:44:34 user nova-compute[73476]: ERROR oslo_messaging.rpc.server 
Aug 26 20:44:34 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:44:34 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:44:34 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=7053MB free_disk=25.590801239013672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:44:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:34 user nova-compute[73476]: INFO nova.compute.manager [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Detaching volume 6ce1022b-a6a3-4652-95ca-93f280ebeb2c
Aug 26 20:44:35 user nova-compute[73476]: INFO nova.virt.block_device [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Attempting to driver detach volume 6ce1022b-a6a3-4652-95ca-93f280ebeb2c from mountpoint /dev/vdb
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Attempting to detach device vdb from instance ee7cf32f-71c2-49ca-8a23-51fc95560974 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 20:44:35 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:35 user nova-compute[73476]:   <source dev="/dev/sdh"/>
Aug 26 20:44:35 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:35 user nova-compute[73476]:   <serial>6ce1022b-a6a3-4652-95ca-93f280ebeb2c</serial>
Aug 26 20:44:35 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:44:35 user nova-compute[73476]: </disk>
Aug 26 20:44:35 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:44:35 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Successfully detached device vdb from instance ee7cf32f-71c2-49ca-8a23-51fc95560974 from the persistent domain config.
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee7cf32f-71c2-49ca-8a23-51fc95560974 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 20:44:35 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:35 user nova-compute[73476]:   <source dev="/dev/sdh"/>
Aug 26 20:44:35 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:44:35 user nova-compute[73476]:   <serial>6ce1022b-a6a3-4652-95ca-93f280ebeb2c</serial>
Aug 26 20:44:35 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:44:35 user nova-compute[73476]: </disk>
Aug 26 20:44:35 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ad42cf47-42fb-488f-a44f-cf9824dd4d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22c72de3-e06b-4aae-bed9-162101a43e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e9309346-2675-4bfd-9781-175b9b40d71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ee7cf32f-71c2-49ca-8a23-51fc95560974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 5160d9ff-3e26-4743-8e34-ebae9fd95f8b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693082675.5108004, ee7cf32f-71c2-49ca-8a23-51fc95560974 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee7cf32f-71c2-49ca-8a23-51fc95560974 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:44:35 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Successfully detached device vdb from instance ee7cf32f-71c2-49ca-8a23-51fc95560974 from the live domain config.
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHIyWLkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:35 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d40651d-6720-440b-93b7-22f42e84c9a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda498ee-0be3-4a35-b0d2-3eb37dc13cc0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:35 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736c83ed-af75-4f58-bddd-ac2711959f81 (non-flash)
Aug 26 20:44:35 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:35 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b0334700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c'): ({'sdh'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Removing single pathed devices sdh {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[34744218-8aeb-4419-b8d1-3264629f0f1a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2f1cac-30d0-4779-b0de-04fd103578b2]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Flushing IO for device /dev/sdh {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcc9dfa-eb50-4ec1-b3bf-47de89f59a19]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.058s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8fcb30-349a-4f42-8d92-e6b4a119daad]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] SCSI volumes sdh have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c386b0e7-88e5-4520-96b4-1ee143435a9f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.204s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6531cf30-277c-403c-b63b-b61cabd76e61]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c, portal: 172.16.0.220,3260]
Aug 26 20:44:35 user nova-compute[73476]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:35 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce1022b-a6a3-4652-95ca-93f280ebeb2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:36 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[63355d98-4ac9-46ab-9700-5940a4cb586e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:36 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:36 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.505s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:36 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] <== disconnect_volume: return (507ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:44:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:37 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lazy-loading 'flavor' on Instance uuid ee7cf32f-71c2-49ca-8a23-51fc95560974 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1ed4177f-541a-4f5f-b925-62147fdce5b9 tempest-VolumesAssistedSnapshotsTest-1894978763 tempest-VolumesAssistedSnapshotsTest-1894978763-project-admin] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.396s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:44:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:44:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:44:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:44:37 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:44:38 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updating instance_info_cache with network_info: [{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:44:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:44:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:44:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFMlwhfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9309346-2675-4bfd-9781-175b9b40d71e', 'attached_at': '', 'detached_at': '', 'volume_id': '592d62f7-8574-4012-81a5-0041153b3872', 'serial': '592d62f7-8574-4012-81a5-0041153b3872'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwEOYgKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e9309346-2675-4bfd-9781-175b9b40d71e', 'attached_at': '', 'detached_at': '', 'volume_id': '239a1e48-548c-4773-9dd0-861c4010261c', 'serial'} {{(pid=73476) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFMlwhfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:44 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:44 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:44 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6459e03-0aae-4985-865b-f83fba42e89e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:44:44 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5174d6-bbbb-4a6d-9607-85751df3e886]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872] added
Aug 26 20:44:44 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d8787-0f01-4c70-a584-5303eb962de3]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb56388-8922-4914-9027-22cbcfbb1a7b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rFMlwhfI {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rFMlwhfI" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0429042c-dc2b-4581-b959-99ff2d09ed3c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rFMlwhfI'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0514936-0c82-4ae4-9b74-09bbbcd1b66c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc5404a-9396-41e2-90c6-3e0556543112]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:44 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:44 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae0549f-b703-4c90-8253-ce81506f30ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872, portal: 172.16.0.220,3260]
Aug 26 20:44:44 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:44 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e79102-7d84-41d1-8aab-c093d6c89281]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d382df8e-d56c-4be1-bbee-8bbc5921aee2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:44 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:44 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:44 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4e6db8-d3a3-47cf-94f5-7e3cfca065b1]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:44 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:44:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:44:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFMlwhfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:44:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26261303061636364', 'path': '/dev/sde'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261303061636364', 'path': '/dev/sde'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:44:45 user nova-compute[73476]: DEBUG nova.objects.instance [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lazy-loading 'flavor' on Instance uuid e9309346-2675-4bfd-9781-175b9b40d71e {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 133169152 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:44:46 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Creating image(s)
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Ensure instance console log exists: /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Start _get_guest_xml network_info=[{"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '90d03a89-a09e-4f58-b8d6-58375ecd8142', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCIXAPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2b05cbc-2666-4c5c-9a5b-be01236a1229', 'attached_at': '', 'detached_at': '', 'volume_id': '9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa', 'serial': '9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:44:46 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:44:46 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCIXAPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:46 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:46 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:46 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5f94e-2635-4746-bf32-d4e6c65b1830]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:44:46 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb5b02b-64f7-4061-9988-78515cc071c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa] added
Aug 26 20:44:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e61979-4bd5-4256-8639-9e610afe6649]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8a7cac-982c-4829-9477-1005d184e339]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCIXAPYO {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCIXAPYO" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[887238d4-ced7-4ac0-b1f3-b40cc94f70a8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HCIXAPYO'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aac04d-8136-40c1-ad7a-160c5b845772]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91329bf-04e8-4344-aaa0-85b41d0e588c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:46 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f83bd78-6071-4986-9f29-cdef182298d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa, portal: 172.16.0.220,3260]
Aug 26 20:44:47 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:47 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f79d17d-53c9-4750-a6e9-0f0cb23116ff]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[466736e5-b69d-47e2-bd83-c6c42ea2b1a7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:47 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e40e5ec-9b63-4547-966f-e12a94a6a148 (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:47 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:47 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b97381f-63b2-46de-8966-063f68d85700]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCIXAPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 297795584 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:44:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 418381824 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23963373264326564', 'path': '/dev/sdh'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963373264326564', 'path': '/dev/sdh'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 499122176 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-495477562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-495477562',id=12,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-w4u5mw1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:44:26Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=c2b05cbc-2666-4c5c-9a5b-be01236a1229,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:db,bridge_name='br-int',has_traffic_filtering=True,id=b51ff675-dbca-4a11-8ed4-a7040a20f850,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51ff675-db') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'pci_devices' on Instance uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:44:48 user nova-compute[73476]:   <uuid>c2b05cbc-2666-4c5c-9a5b-be01236a1229</uuid>
Aug 26 20:44:48 user nova-compute[73476]:   <name>instance-0000000c</name>
Aug 26 20:44:48 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:44:48 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:44:48 user nova-compute[73476]:   <metadata>
Aug 26 20:44:48 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:44:48 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:44:48 user nova-compute[73476]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-495477562</nova:name>
Aug 26 20:44:48 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:44:46</nova:creationTime>
Aug 26 20:44:48 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:44:48 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:44:48 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:44:48 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:44:48 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:44:48 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:44:48 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:44:48 user nova-compute[73476]:       <nova:owner>
Aug 26 20:44:48 user nova-compute[73476]:         <nova:user uuid="5ed2a98f37294fd381fd1dfe7c5c0751">tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member</nova:user>
Aug 26 20:44:48 user nova-compute[73476]:         <nova:project uuid="679727d63ba04ad48740d1b967be5a61">tempest-ServerBootFromVolumeStableRescueTest-735166680</nova:project>
Aug 26 20:44:48 user nova-compute[73476]:       </nova:owner>
Aug 26 20:44:48 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:44:48 user nova-compute[73476]:       <nova:ports>
Aug 26 20:44:48 user nova-compute[73476]:         <nova:port uuid="b51ff675-dbca-4a11-8ed4-a7040a20f850">
Aug 26 20:44:48 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 20:44:48 user nova-compute[73476]:         </nova:port>
Aug 26 20:44:48 user nova-compute[73476]:       </nova:ports>
Aug 26 20:44:48 user nova-compute[73476]:     </nova:instance>
Aug 26 20:44:48 user nova-compute[73476]:   </metadata>
Aug 26 20:44:48 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:44:48 user nova-compute[73476]:     <system>
Aug 26 20:44:48 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:44:48 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:44:48 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:44:48 user nova-compute[73476]:       <entry name="serial">c2b05cbc-2666-4c5c-9a5b-be01236a1229</entry>
Aug 26 20:44:48 user nova-compute[73476]:       <entry name="uuid">c2b05cbc-2666-4c5c-9a5b-be01236a1229</entry>
Aug 26 20:44:48 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:44:48 user nova-compute[73476]:     </system>
Aug 26 20:44:48 user nova-compute[73476]:   </sysinfo>
Aug 26 20:44:48 user nova-compute[73476]:   <os>
Aug 26 20:44:48 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:44:48 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:44:48 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:44:48 user nova-compute[73476]:   </os>
Aug 26 20:44:48 user nova-compute[73476]:   <features>
Aug 26 20:44:48 user nova-compute[73476]:     <acpi/>
Aug 26 20:44:48 user nova-compute[73476]:     <apic/>
Aug 26 20:44:48 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:44:48 user nova-compute[73476]:   </features>
Aug 26 20:44:48 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:44:48 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:44:48 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:44:48 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:44:48 user nova-compute[73476]:   </clock>
Aug 26 20:44:48 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:44:48 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:44:48 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:44:48 user nova-compute[73476]:   </cpu>
Aug 26 20:44:48 user nova-compute[73476]:   <devices>
Aug 26 20:44:48 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:44:48 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:44:48 user nova-compute[73476]:       <source dev="/dev/sdh"/>
Aug 26 20:44:48 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:44:48 user nova-compute[73476]:       <serial>9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa</serial>
Aug 26 20:44:48 user nova-compute[73476]:     </disk>
Aug 26 20:44:48 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:44:48 user nova-compute[73476]:       <mac address="fa:16:3e:47:43:db"/>
Aug 26 20:44:48 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:44:48 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:44:48 user nova-compute[73476]:       <target dev="tapb51ff675-db"/>
Aug 26 20:44:48 user nova-compute[73476]:     </interface>
Aug 26 20:44:48 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:44:48 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/console.log" append="off"/>
Aug 26 20:44:48 user nova-compute[73476]:     </serial>
Aug 26 20:44:48 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:44:48 user nova-compute[73476]:     <video>
Aug 26 20:44:48 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:44:48 user nova-compute[73476]:     </video>
Aug 26 20:44:48 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:44:48 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:44:48 user nova-compute[73476]:     </rng>
Aug 26 20:44:48 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:44:48 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:44:48 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:44:48 user nova-compute[73476]:     </memballoon>
Aug 26 20:44:48 user nova-compute[73476]:   </devices>
Aug 26 20:44:48 user nova-compute[73476]: </domain>
Aug 26 20:44:48 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-495477562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-495477562',id=12,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-w4u5mw1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:44:26Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=c2b05cbc-2666-4c5c-9a5b-be01236a1229,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:db,bridge_name='br-int',has_traffic_filtering=True,id=b51ff675-dbca-4a11-8ed4-a7040a20f850,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51ff675-db') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG os_vif [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:db,bridge_name='br-int',has_traffic_filtering=True,id=b51ff675-dbca-4a11-8ed4-a7040a20f850,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51ff675-db') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb51ff675-db, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb51ff675-db, col_values=(('external_ids', {'iface-id': 'b51ff675-dbca-4a11-8ed4-a7040a20f850', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:43:db', 'vm-uuid': 'c2b05cbc-2666-4c5c-9a5b-be01236a1229'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:48 user nova-compute[73476]: INFO os_vif [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:43:db,bridge_name='br-int',has_traffic_filtering=True,id=b51ff675-dbca-4a11-8ed4-a7040a20f850,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51ff675-db')
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No VIF found with MAC fa:16:3e:47:43:db, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:44:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 630194176 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:44:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 804257792 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:44:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 972029952 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:44:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-5632d8a6-0ebc-4b91-ba29-aa10461ef5a0 req-53a55a1b-0c1d-4cdd-8d24-e3b8531c6aba service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5632d8a6-0ebc-4b91-ba29-aa10461ef5a0 req-53a55a1b-0c1d-4cdd-8d24-e3b8531c6aba service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5632d8a6-0ebc-4b91-ba29-aa10461ef5a0 req-53a55a1b-0c1d-4cdd-8d24-e3b8531c6aba service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5632d8a6-0ebc-4b91-ba29-aa10461ef5a0 req-53a55a1b-0c1d-4cdd-8d24-e3b8531c6aba service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-5632d8a6-0ebc-4b91-ba29-aa10461ef5a0 req-53a55a1b-0c1d-4cdd-8d24-e3b8531c6aba service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:50 user nova-compute[73476]: WARNING nova.compute.manager [req-5632d8a6-0ebc-4b91-ba29-aa10461ef5a0 req-53a55a1b-0c1d-4cdd-8d24-e3b8531c6aba service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state building and task_state spawning.
Aug 26 20:44:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwEOYgKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:50 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e94524-c94d-4e6a-afe6-48226cbbe06d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c01483e-c9c3-4483-b7fc-e521233b443c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:44:50 user nova-compute[73476]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:44:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02909d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c'): ({'sdg'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Removing single pathed devices sdg {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e5374d-9ab7-4060-8f01-8002503e48df]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8109a47d-1b2c-4eee-9b6d-aa145398d07e]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Flushing IO for device /dev/sdg {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bc9699-277a-40de-82e4-72f7a46dcdfa]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f225a262-2b06-46d3-801c-bb1e186d65b7]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] SCSI volumes sdg have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[462ecdf3-2048-4964-aaeb-9bb9c9913f4b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[178a17a6-fc8b-4984-99d3-3ba1481a084e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260]
Aug 26 20:44:50 user nova-compute[73476]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260] successful.
Aug 26 20:44:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9538e691-0a06-41e2-acad-fcdb494586e5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] <== disconnect_volume: return (339ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFMlwhfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'e9309346-2675-4bfd-9781-175b9b40d71e', 'attached_at': '', 'detached_at': '', 'volume_id': '592d62f7-8574-4012-81a5-0041153b3872', 'serial'} {{(pid=73476) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 20:44:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] swap_volume: removing Cinder connection for volume 239a1e48-548c-4773-9dd0-861c4010261c {{(pid=73476) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 20:44:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] swap_volume: Updating volume 239a1e48-548c-4773-9dd0-861c4010261c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "rFMlwhfI", "auth_password": "7Rb1YGlc9UjOqS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "592d62f7-8574-4012-81a5-0041153b3872"}, "status": "reserved", "instance": "e9309346-2675-4bfd-9781-175b9b40d71e", "attached_at": "", "detached_at": "", "volume_id": "592d62f7-8574-4012-81a5-0041153b3872", "serial": "592d62f7-8574-4012-81a5-0041153b3872"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '592d62f7-8574-4012-81a5-0041153b3872', 'no_device': None, 'attachment_id': '0279577a-4c17-44ca-ac93-110c1d5d774c'} {{(pid=73476) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 20:44:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-477dd7cd-b1da-4554-b3bc-0a0909363eb0 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.773s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-c799fb4f-099d-4505-adcb-d7d7dd2a37c5 req-6a5b2747-ec34-4edf-8a18-965b8a091968 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c799fb4f-099d-4505-adcb-d7d7dd2a37c5 req-6a5b2747-ec34-4edf-8a18-965b8a091968 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c799fb4f-099d-4505-adcb-d7d7dd2a37c5 req-6a5b2747-ec34-4edf-8a18-965b8a091968 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c799fb4f-099d-4505-adcb-d7d7dd2a37c5 req-6a5b2747-ec34-4edf-8a18-965b8a091968 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-c799fb4f-099d-4505-adcb-d7d7dd2a37c5 req-6a5b2747-ec34-4edf-8a18-965b8a091968 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:44:52 user nova-compute[73476]: WARNING nova.compute.manager [req-c799fb4f-099d-4505-adcb-d7d7dd2a37c5 req-6a5b2747-ec34-4edf-8a18-965b8a091968 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state building and task_state spawning.
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082692.2849922, c2b05cbc-2666-4c5c-9a5b-be01236a1229 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:44:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] VM Resumed (Lifecycle Event)
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:44:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Instance spawned successfully.
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:44:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082692.2872975, c2b05cbc-2666-4c5c-9a5b-be01236a1229 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:44:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] VM Started (Lifecycle Event)
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:44:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:44:52 user nova-compute[73476]: INFO nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 26 20:44:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:44:52 user nova-compute[73476]: INFO nova.compute.manager [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Took 26.82 seconds to build instance.
Aug 26 20:44:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1a132411-c09d-4446-a254-e06d0410b522 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.930s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG os_brick.utils [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0833b3db-61a1-4406-8aa6-08d82f31801c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b963dbdb-a5b0-4d2d-8fce-e312aafe852b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bb5ce7-2255-4495-bf40-af32f5d44804]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b2510c-95ac-49a1-ba3c-c237c0613846]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:44:53 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:44:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c244cd5-a721-45fe-a4d3-315f454ce1f9]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG os_brick.utils [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:44:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:53 user nova-compute[73476]: INFO nova.compute.manager [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Swapping volume 592d62f7-8574-4012-81a5-0041153b3872 for 239a1e48-548c-4773-9dd0-861c4010261c
Aug 26 20:44:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:44:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:45:05 user nova-compute[73476]: INFO nova.compute.claims [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Claim successful on node user
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:45:05 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.policy [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f2bee4738d4442fabd6c6a802070555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b92247b70b4ef6ab0d4bbb6a8a60f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:45:05 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Creating image(s)
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "/opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "/opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "/opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.218s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk 1073741824" returned: 0 in 0.145s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Successfully created port: 060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwEOYgKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9309346-2675-4bfd-9781-175b9b40d71e', 'attached_at': '', 'detached_at': '', 'volume_id': '239a1e48-548c-4773-9dd0-861c4010261c', 'serial': '239a1e48-548c-4773-9dd0-861c4010261c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFMlwhfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '592d62f7-8574-4012-81a5-0041153b3872'}, 'status': 'reserved', 'instance': 'e9309346-2675-4bfd-9781-175b9b40d71e', 'attached_at': '', 'detached_at': '', 'volume_id': '592d62f7-8574-4012-81a5-0041153b3872', 'serial'} {{(pid=73476) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwEOYgKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:06 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:06 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:06 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Cannot resize image /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Ensure instance console log exists: /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9819a489-7463-4a5e-8381-3e8d688df7e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:45:06 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e8586c-1e7c-4dad-a7e8-565c9178fd30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c] added
Aug 26 20:45:06 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[07004a6f-5181-4e93-8204-30169285582a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbe9499-a567-4c2d-9665-fd9d6a62e1b5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwEOYgKU {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwEOYgKU" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[64170536-7458-482a-99f3-141f20e2806e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PwEOYgKU'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d092017a-fa5a-4ace-88dc-273c75ad2a9c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c0d1ed-0ff5-452a-8423-bbff5314fdf1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:45:06 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:06 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:06 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:06 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:06 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:45:06 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:06 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:06 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:06 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:06 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[de50981c-a113-4303-a4b8-c22b5be3b5d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260]
Aug 26 20:45:07 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260] successful.
Aug 26 20:45:07 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.111s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc891ec-6249-404f-bc2c-a3e241fffb90]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9970c2-dfdf-4aca-b67d-e345995e27bf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:07 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:07 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:07 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae3582-9df1-400e-a413-349883269f0f]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwEOYgKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Successfully updated port: 060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "refresh_cache-adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquired lock "refresh_cache-adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-eae055ce-e290-45ac-84c7-acf47fbaefb6 req-c3d3fd45-b879-48d4-babd-147b8272c212 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received event network-changed-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-eae055ce-e290-45ac-84c7-acf47fbaefb6 req-c3d3fd45-b879-48d4-babd-147b8272c212 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Refreshing instance network info cache due to event network-changed-060363f6-386f-4d72-a85f-cd40470f2a87. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-eae055ce-e290-45ac-84c7-acf47fbaefb6 req-c3d3fd45-b879-48d4-babd-147b8272c212 service nova] Acquiring lock "refresh_cache-adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:45:07 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Updating instance_info_cache with network_info: [{"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Releasing lock "refresh_cache-adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Instance network_info: |[{"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-eae055ce-e290-45ac-84c7-acf47fbaefb6 req-c3d3fd45-b879-48d4-babd-147b8272c212 service nova] Acquired lock "refresh_cache-adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.network.neutron [req-eae055ce-e290-45ac-84c7-acf47fbaefb6 req-c3d3fd45-b879-48d4-babd-147b8272c212 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Refreshing network info cache for port 060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Start _get_guest_xml network_info=[{"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:45:08 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:45:08 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-290381088',display_name='tempest-VolumesAdminNegativeTest-server-290381088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-290381088',id=13,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0b92247b70b4ef6ab0d4bbb6a8a60f0',ramdisk_id='',reservation_id='r-tuy5h5tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1926983424',owner_user_name='tempest-VolumesAdminNegativeTest-1926983424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:45:06Z,user_data=None,user_id='0f2bee4738d4442fabd6c6a802070555',uuid=adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converting VIF {"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=060363f6-386f-4d72-a85f-cd40470f2a87,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060363f6-38') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lazy-loading 'pci_devices' on Instance uuid adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '26664353238623362', 'path': '/dev/sdf'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664353238623362', 'path': '/dev/sdf'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:45:08 user nova-compute[73476]:   <uuid>adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1</uuid>
Aug 26 20:45:08 user nova-compute[73476]:   <name>instance-0000000d</name>
Aug 26 20:45:08 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:45:08 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:45:08 user nova-compute[73476]:   <metadata>
Aug 26 20:45:08 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:45:08 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:45:08 user nova-compute[73476]:       <nova:name>tempest-VolumesAdminNegativeTest-server-290381088</nova:name>
Aug 26 20:45:08 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:45:08</nova:creationTime>
Aug 26 20:45:08 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:45:08 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:45:08 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:45:08 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:45:08 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:45:08 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:45:08 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:45:08 user nova-compute[73476]:       <nova:owner>
Aug 26 20:45:08 user nova-compute[73476]:         <nova:user uuid="0f2bee4738d4442fabd6c6a802070555">tempest-VolumesAdminNegativeTest-1926983424-project-member</nova:user>
Aug 26 20:45:08 user nova-compute[73476]:         <nova:project uuid="f0b92247b70b4ef6ab0d4bbb6a8a60f0">tempest-VolumesAdminNegativeTest-1926983424</nova:project>
Aug 26 20:45:08 user nova-compute[73476]:       </nova:owner>
Aug 26 20:45:08 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:45:08 user nova-compute[73476]:       <nova:ports>
Aug 26 20:45:08 user nova-compute[73476]:         <nova:port uuid="060363f6-386f-4d72-a85f-cd40470f2a87">
Aug 26 20:45:08 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:45:08 user nova-compute[73476]:         </nova:port>
Aug 26 20:45:08 user nova-compute[73476]:       </nova:ports>
Aug 26 20:45:08 user nova-compute[73476]:     </nova:instance>
Aug 26 20:45:08 user nova-compute[73476]:   </metadata>
Aug 26 20:45:08 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:45:08 user nova-compute[73476]:     <system>
Aug 26 20:45:08 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:45:08 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:45:08 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:45:08 user nova-compute[73476]:       <entry name="serial">adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1</entry>
Aug 26 20:45:08 user nova-compute[73476]:       <entry name="uuid">adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1</entry>
Aug 26 20:45:08 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:45:08 user nova-compute[73476]:     </system>
Aug 26 20:45:08 user nova-compute[73476]:   </sysinfo>
Aug 26 20:45:08 user nova-compute[73476]:   <os>
Aug 26 20:45:08 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:45:08 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:45:08 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:45:08 user nova-compute[73476]:   </os>
Aug 26 20:45:08 user nova-compute[73476]:   <features>
Aug 26 20:45:08 user nova-compute[73476]:     <acpi/>
Aug 26 20:45:08 user nova-compute[73476]:     <apic/>
Aug 26 20:45:08 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:45:08 user nova-compute[73476]:   </features>
Aug 26 20:45:08 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:45:08 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:45:08 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:45:08 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:45:08 user nova-compute[73476]:   </clock>
Aug 26 20:45:08 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:45:08 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:45:08 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:45:08 user nova-compute[73476]:   </cpu>
Aug 26 20:45:08 user nova-compute[73476]:   <devices>
Aug 26 20:45:08 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:45:08 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:45:08 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk"/>
Aug 26 20:45:08 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:45:08 user nova-compute[73476]:     </disk>
Aug 26 20:45:08 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:45:08 user nova-compute[73476]:       <mac address="fa:16:3e:91:f2:21"/>
Aug 26 20:45:08 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:45:08 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:45:08 user nova-compute[73476]:       <target dev="tap060363f6-38"/>
Aug 26 20:45:08 user nova-compute[73476]:     </interface>
Aug 26 20:45:08 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:45:08 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/console.log" append="off"/>
Aug 26 20:45:08 user nova-compute[73476]:     </serial>
Aug 26 20:45:08 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:45:08 user nova-compute[73476]:     <video>
Aug 26 20:45:08 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:45:08 user nova-compute[73476]:     </video>
Aug 26 20:45:08 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:45:08 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:45:08 user nova-compute[73476]:     </rng>
Aug 26 20:45:08 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:45:08 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:45:08 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:45:08 user nova-compute[73476]:     </memballoon>
Aug 26 20:45:08 user nova-compute[73476]:   </devices>
Aug 26 20:45:08 user nova-compute[73476]: </domain>
Aug 26 20:45:08 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-290381088',display_name='tempest-VolumesAdminNegativeTest-server-290381088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-290381088',id=13,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0b92247b70b4ef6ab0d4bbb6a8a60f0',ramdisk_id='',reservation_id='r-tuy5h5tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1926983424',owner_user_name='tempest-VolumesAdminNegativeTest-1926983424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:45:06Z,user_data=None,user_id='0f2bee4738d4442fabd6c6a802070555',uuid=adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converting VIF {"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=060363f6-386f-4d72-a85f-cd40470f2a87,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060363f6-38') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG os_vif [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=060363f6-386f-4d72-a85f-cd40470f2a87,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060363f6-38') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.objects.instance [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lazy-loading 'flavor' on Instance uuid e9309346-2675-4bfd-9781-175b9b40d71e {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap060363f6-38, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap060363f6-38, col_values=(('external_ids', {'iface-id': '060363f6-386f-4d72-a85f-cd40470f2a87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:f2:21', 'vm-uuid': 'adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:08 user nova-compute[73476]: INFO os_vif [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=060363f6-386f-4d72-a85f-cd40470f2a87,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060363f6-38')
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] No VIF found with MAC fa:16:3e:91:f2:21, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.network.neutron [req-eae055ce-e290-45ac-84c7-acf47fbaefb6 req-c3d3fd45-b879-48d4-babd-147b8272c212 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Updated VIF entry in instance network info cache for port 060363f6-386f-4d72-a85f-cd40470f2a87. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.network.neutron [req-eae055ce-e290-45ac-84c7-acf47fbaefb6 req-c3d3fd45-b879-48d4-babd-147b8272c212 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Updating instance_info_cache with network_info: [{"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-eae055ce-e290-45ac-84c7-acf47fbaefb6 req-c3d3fd45-b879-48d4-babd-147b8272c212 service nova] Releasing lock "refresh_cache-adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:45:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:45:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 135266304 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:45:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 307232768 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 477102080 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-58f7cc5f-67e0-4911-be1b-79fbe08d433d req-ca02516a-8156-4b62-a5a2-7aea3b7d9c62 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received event network-vif-plugged-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-58f7cc5f-67e0-4911-be1b-79fbe08d433d req-ca02516a-8156-4b62-a5a2-7aea3b7d9c62 service nova] Acquiring lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-58f7cc5f-67e0-4911-be1b-79fbe08d433d req-ca02516a-8156-4b62-a5a2-7aea3b7d9c62 service nova] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-58f7cc5f-67e0-4911-be1b-79fbe08d433d req-ca02516a-8156-4b62-a5a2-7aea3b7d9c62 service nova] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-58f7cc5f-67e0-4911-be1b-79fbe08d433d req-ca02516a-8156-4b62-a5a2-7aea3b7d9c62 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] No waiting events found dispatching network-vif-plugged-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:10 user nova-compute[73476]: WARNING nova.compute.manager [req-58f7cc5f-67e0-4911-be1b-79fbe08d433d req-ca02516a-8156-4b62-a5a2-7aea3b7d9c62 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received unexpected event network-vif-plugged-060363f6-386f-4d72-a85f-cd40470f2a87 for instance with vm_state building and task_state spawning.
Aug 26 20:45:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 610271232 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:45:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 746586112 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:45:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 915406848 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFMlwhfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '592d62f7-8574-4012-81a5-0041153b3872'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:12 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3552f3-8ad6-4422-90b8-8e94658108a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f6bb3-1a78-4f6f-8d10-19094d5a2d61]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:12 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d0128310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872'): ({'sde'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Removing single pathed devices sde {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1d5a63-e6c0-45e5-8917-457eec3d6948]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4830aaf-1aa4-4f38-a988-831e90ae3bc1]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Flushing IO for device /dev/sde {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f660a09-4c9a-4b14-b981-9242692d6957]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-83027873-cc75-4239-aa3e-2777c7080b26 req-5e63adde-2653-44cc-9373-cd6310972902 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received event network-vif-plugged-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-83027873-cc75-4239-aa3e-2777c7080b26 req-5e63adde-2653-44cc-9373-cd6310972902 service nova] Acquiring lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-83027873-cc75-4239-aa3e-2777c7080b26 req-5e63adde-2653-44cc-9373-cd6310972902 service nova] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-83027873-cc75-4239-aa3e-2777c7080b26 req-5e63adde-2653-44cc-9373-cd6310972902 service nova] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-83027873-cc75-4239-aa3e-2777c7080b26 req-5e63adde-2653-44cc-9373-cd6310972902 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] No waiting events found dispatching network-vif-plugged-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:12 user nova-compute[73476]: WARNING nova.compute.manager [req-83027873-cc75-4239-aa3e-2777c7080b26 req-5e63adde-2653-44cc-9373-cd6310972902 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received unexpected event network-vif-plugged-060363f6-386f-4d72-a85f-cd40470f2a87 for instance with vm_state building and task_state spawning.
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2bac16-1217-402a-94ac-73c552083c0b]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3f54d6-1e7e-4e24-8b54-b232b61a4fc2]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8425bec5-bc30-4b8f-a532-a73921dc3d01]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872, portal: 172.16.0.220,3260]
Aug 26 20:45:12 user nova-compute[73476]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872, portal: 172.16.0.220,3260] successful.
Aug 26 20:45:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:592d62f7-8574-4012-81a5-0041153b3872 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ecf167-8fd5-4516-bb92-a6c03a5ea17b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] <== disconnect_volume: return (342ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082712.7591243, adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:45:12 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] VM Resumed (Lifecycle Event)
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:45:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Instance spawned successfully.
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:12 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082712.7599401, adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:45:12 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] VM Started (Lifecycle Event)
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwEOYgKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'e9309346-2675-4bfd-9781-175b9b40d71e', 'attached_at': '', 'detached_at': '', 'volume_id': '239a1e48-548c-4773-9dd0-861c4010261c', 'serial'} {{(pid=73476) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] swap_volume: removing Cinder connection for volume 592d62f7-8574-4012-81a5-0041153b3872 {{(pid=73476) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:45:12 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:45:12 user nova-compute[73476]: INFO nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Took 7.11 seconds to spawn the instance on the hypervisor.
Aug 26 20:45:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:45:12 user nova-compute[73476]: INFO nova.compute.manager [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Took 7.94 seconds to build instance.
Aug 26 20:45:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb21737e-60ea-49d8-8c30-728ca2af7985 tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.036s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:13 user nova-compute[73476]: DEBUG nova.compute.manager [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] swap_volume: Updating volume 592d62f7-8574-4012-81a5-0041153b3872 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "PwEOYgKU", "auth_password": "O8Kd9nAWQamkUy", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "239a1e48-548c-4773-9dd0-861c4010261c"}, "status": "reserved", "instance": "e9309346-2675-4bfd-9781-175b9b40d71e", "attached_at": "", "detached_at": "", "volume_id": "239a1e48-548c-4773-9dd0-861c4010261c", "serial": "239a1e48-548c-4773-9dd0-861c4010261c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '239a1e48-548c-4773-9dd0-861c4010261c', 'no_device': None, 'attachment_id': 'a9f875ac-fdc9-429c-8809-d90087d0d1ca'} {{(pid=73476) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 20:45:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-000ad729-d080-424d-96e8-f2733c985449 tempest-TestVolumeSwap-1747059856 tempest-TestVolumeSwap-1747059856-project-admin] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.705s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:15 user nova-compute[73476]: INFO nova.compute.manager [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Detaching volume 239a1e48-548c-4773-9dd0-861c4010261c
Aug 26 20:45:15 user nova-compute[73476]: INFO nova.virt.block_device [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Attempting to driver detach volume 239a1e48-548c-4773-9dd0-861c4010261c from mountpoint /dev/vdb
Aug 26 20:45:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Attempting to detach device vdb from instance e9309346-2675-4bfd-9781-175b9b40d71e from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:45:15 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:45:15 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:45:15 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:45:15 user nova-compute[73476]:   <serial>239a1e48-548c-4773-9dd0-861c4010261c</serial>
Aug 26 20:45:15 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:45:15 user nova-compute[73476]: </disk>
Aug 26 20:45:15 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:45:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Successfully detached device vdb from instance e9309346-2675-4bfd-9781-175b9b40d71e from the persistent domain config.
Aug 26 20:45:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e9309346-2675-4bfd-9781-175b9b40d71e from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:45:15 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:45:15 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:45:15 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:45:15 user nova-compute[73476]:   <serial>239a1e48-548c-4773-9dd0-861c4010261c</serial>
Aug 26 20:45:15 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:45:15 user nova-compute[73476]: </disk>
Aug 26 20:45:15 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693082715.7769454, e9309346-2675-4bfd-9781-175b9b40d71e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e9309346-2675-4bfd-9781-175b9b40d71e {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:45:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Successfully detached device vdb from instance e9309346-2675-4bfd-9781-175b9b40d71e from the live domain config.
Aug 26 20:45:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwEOYgKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '239a1e48-548c-4773-9dd0-861c4010261c'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:15 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb7298e-6169-40a4-b0ee-5fa80c098c7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1012b42c-a57f-49e3-abae-abcc6b89842f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:15 user nova-compute[73476]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:45:15 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:15 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:15 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:15 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:15 user nova-compute[73476]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c (non-flash)
Aug 26 20:45:15 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:15 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:15 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:15 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d00ae170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c'): ({'sdf'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Removing single pathed devices sdf {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dd9d53-cb4e-4348-84f9-1acd3bcd6cdd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46fd251-4058-4a72-ba0c-891e6c7c7369]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Flushing IO for device /dev/sdf {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3d2352-eadc-416c-add7-4c6e12bda55c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a5fd47-ced9-4422-99c5-9ad9e2b79113]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:45:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e421a8b-930c-4bca-b565-21546c8431d7]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ecee1b-c3dd-4efa-bb84-32e3558829a7]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260]
Aug 26 20:45:16 user nova-compute[73476]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c, portal: 172.16.0.220,3260] successful.
Aug 26 20:45:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239a1e48-548c-4773-9dd0-861c4010261c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d21fa4a-2faf-4ac7-831a-748c5f5af79e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] <== disconnect_volume: return (350ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:45:17 user nova-compute[73476]: DEBUG nova.objects.instance [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lazy-loading 'flavor' on Instance uuid e9309346-2675-4bfd-9781-175b9b40d71e {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:45:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5625df44-fd78-451b-9153-6b492cc3a5ff tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.890s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:21 user nova-compute[73476]: INFO nova.compute.manager [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Terminating instance
Aug 26 20:45:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:45:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:45:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:45:22 user nova-compute[73476]: INFO nova.compute.claims [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Claim successful on node user
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-efd33ff0-80f1-46a8-b9c7-b540e1b26a3d req-276eb333-be7a-4eb2-861e-f947fc0d2d40 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-unplugged-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-efd33ff0-80f1-46a8-b9c7-b540e1b26a3d req-276eb333-be7a-4eb2-861e-f947fc0d2d40 service nova] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-efd33ff0-80f1-46a8-b9c7-b540e1b26a3d req-276eb333-be7a-4eb2-861e-f947fc0d2d40 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-efd33ff0-80f1-46a8-b9c7-b540e1b26a3d req-276eb333-be7a-4eb2-861e-f947fc0d2d40 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-efd33ff0-80f1-46a8-b9c7-b540e1b26a3d req-276eb333-be7a-4eb2-861e-f947fc0d2d40 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] No waiting events found dispatching network-vif-unplugged-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-efd33ff0-80f1-46a8-b9c7-b540e1b26a3d req-276eb333-be7a-4eb2-861e-f947fc0d2d40 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-unplugged-dc8013cf-f972-4d70-a041-b91ace1b537d for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:45:22 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Instance destroyed successfully.
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.objects.instance [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lazy-loading 'resources' on Instance uuid 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309021978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309021978',id=8,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJv500ICYQkC8rlDl0rZ7fAGTJyj7kZ3tpS7wPZK0hi+dNo8U4bebGF/MrGe9anTbwaWZhwe37G7Y+gRDfa2LkkTJlaTK44hxXQMKLQOS5XgexamGee3hm5aT5V94z3v7Q==',key_name='tempest-keypair-1352386032',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59d347b5c87b440296fde039405de11d',ramdisk_id='',reservation_id='r-i0hj5l0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687865165',owner_user_name='tempest-TaggedAttachmentsTest-687865165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e9f1517b4574f2dbe3def073c65a0c7',uuid=8150e248-6046-4d1e-bb7c-3b94cd6d30e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converting VIF {"id": "dc8013cf-f972-4d70-a041-b91ace1b537d", "address": "fa:16:3e:e8:92:f2", "network": {"id": "632776c0-e757-4743-b525-fcf9b0a11560", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1643486328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59d347b5c87b440296fde039405de11d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8013cf-f9", "ovs_interfaceid": "dc8013cf-f972-4d70-a041-b91ace1b537d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=dc8013cf-f972-4d70-a041-b91ace1b537d,network=Network(632776c0-e757-4743-b525-fcf9b0a11560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8013cf-f9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG os_vif [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=dc8013cf-f972-4d70-a041-b91ace1b537d,network=Network(632776c0-e757-4743-b525-fcf9b0a11560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8013cf-f9') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc8013cf-f9, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:22 user nova-compute[73476]: INFO os_vif [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=dc8013cf-f972-4d70-a041-b91ace1b537d,network=Network(632776c0-e757-4743-b525-fcf9b0a11560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8013cf-f9')
Aug 26 20:45:22 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Deleting instance files /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5_del
Aug 26 20:45:22 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Deletion of /opt/stack/data/nova/instances/8150e248-6046-4d1e-bb7c-3b94cd6d30e5_del complete
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:45:22 user nova-compute[73476]: INFO nova.compute.manager [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 20:45:22 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.800s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:45:23 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:45:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:45:23 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Creating image(s)
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG nova.policy [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdf18fb0dcd64e11a7e42cc5184a219e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b16d8f644f0442fea1f8a57961111a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk 1073741824" returned: 0 in 0.050s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.172s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Cannot resize image /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Ensure instance console log exists: /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-5a6e72a9-2439-40b3-9ac8-cd8f3361ef7c req-f90efb03-f7cc-4212-8ddc-9e6d9349b7f0 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-plugged-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5a6e72a9-2439-40b3-9ac8-cd8f3361ef7c req-f90efb03-f7cc-4212-8ddc-9e6d9349b7f0 service nova] Acquiring lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5a6e72a9-2439-40b3-9ac8-cd8f3361ef7c req-f90efb03-f7cc-4212-8ddc-9e6d9349b7f0 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5a6e72a9-2439-40b3-9ac8-cd8f3361ef7c req-f90efb03-f7cc-4212-8ddc-9e6d9349b7f0 service nova] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-5a6e72a9-2439-40b3-9ac8-cd8f3361ef7c req-f90efb03-f7cc-4212-8ddc-9e6d9349b7f0 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] No waiting events found dispatching network-vif-plugged-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:24 user nova-compute[73476]: WARNING nova.compute.manager [req-5a6e72a9-2439-40b3-9ac8-cd8f3361ef7c req-f90efb03-f7cc-4212-8ddc-9e6d9349b7f0 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received unexpected event network-vif-plugged-dc8013cf-f972-4d70-a041-b91ace1b537d for instance with vm_state active and task_state deleting.
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:24 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Took 1.96 seconds to deallocate network for instance.
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-e8d96caf-ff86-4617-b8e8-6b72f19de852 req-fd7d4825-8ef3-4782-acfb-0b3888ae4504 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Received event network-vif-deleted-dc8013cf-f972-4d70-a041-b91ace1b537d {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:24 user nova-compute[73476]: INFO nova.compute.manager [req-e8d96caf-ff86-4617-b8e8-6b72f19de852 req-fd7d4825-8ef3-4782-acfb-0b3888ae4504 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Neutron deleted interface dc8013cf-f972-4d70-a041-b91ace1b537d; detaching it from the instance and deleting it from the info cache
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.network.neutron [req-e8d96caf-ff86-4617-b8e8-6b72f19de852 req-fd7d4825-8ef3-4782-acfb-0b3888ae4504 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-e8d96caf-ff86-4617-b8e8-6b72f19de852 req-fd7d4825-8ef3-4782-acfb-0b3888ae4504 service nova] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Detach interface failed, port_id=dc8013cf-f972-4d70-a041-b91ace1b537d, reason: Instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Successfully created port: 920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lazy-loading 'flavor' on Instance uuid ad42cf47-42fb-488f-a44f-cf9824dd4d99 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.633s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:25 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Deleted allocations for instance 8150e248-6046-4d1e-bb7c-3b94cd6d30e5
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-334131c5-249e-4663-beb2-c5035430c789 tempest-TaggedAttachmentsTest-687865165 tempest-TaggedAttachmentsTest-687865165-project-member] Lock "8150e248-6046-4d1e-bb7c-3b94cd6d30e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.859s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:25 user nova-compute[73476]: INFO nova.compute.manager [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Attaching volume 8809a5b6-d0f3-4f59-b94e-220073f5f4c2 to /dev/vdb
Aug 26 20:45:25 user nova-compute[73476]: DEBUG os_brick.utils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed57dd41-1a42-4c44-bebb-5d86689476e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0616466-26fe-4989-80ef-359ca93e1202]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8f8ba2-fe7a-496c-be10-1b84d5002b92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[478f957a-58f7-4c5d-89f5-21e1a67028cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:45:25 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:45:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea16e44-9aff-49d6-89d0-98fbaafb1386]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG os_brick.utils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:25 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating existing volume attachment record: 4c8d7dd3-71d6-4513-a8f6-c5a8ff7cce05 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Successfully updated port: 920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "refresh_cache-eaf9f058-2194-4e0e-9460-328108758c42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquired lock "refresh_cache-eaf9f058-2194-4e0e-9460-328108758c42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Updating instance_info_cache with network_info: [{"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Releasing lock "refresh_cache-eaf9f058-2194-4e0e-9460-328108758c42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Instance network_info: |[{"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Start _get_guest_xml network_info=[{"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:45:26 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:45:26 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-924396',display_name='tempest-tempest.common.compute-instance-924396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-924396',id=14,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV/yd8kfxlaTWXrDZ3wbLsadxJe1f2WQOA3s+97nsG/XDorWSKUuwbAAV+UBcfNkZOqvbKg3jvF1sQHB2BfsglNHCVhOpK2aXH6Iq8Qok+VhT6HbE2h3S1fpQjHJ8cjDw==',key_name='tempest-keypair-710174093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-qgortcq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:45:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=eaf9f058-2194-4e0e-9460-328108758c42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'pci_devices' on Instance uuid eaf9f058-2194-4e0e-9460-328108758c42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:45:26 user nova-compute[73476]:   <uuid>eaf9f058-2194-4e0e-9460-328108758c42</uuid>
Aug 26 20:45:26 user nova-compute[73476]:   <name>instance-0000000e</name>
Aug 26 20:45:26 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:45:26 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:45:26 user nova-compute[73476]:   <metadata>
Aug 26 20:45:26 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:45:26 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:45:26 user nova-compute[73476]:       <nova:name>tempest-tempest.common.compute-instance-924396</nova:name>
Aug 26 20:45:26 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:45:26</nova:creationTime>
Aug 26 20:45:26 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:45:26 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:45:26 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:45:26 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:45:26 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:45:26 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:45:26 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:45:26 user nova-compute[73476]:       <nova:owner>
Aug 26 20:45:26 user nova-compute[73476]:         <nova:user uuid="fdf18fb0dcd64e11a7e42cc5184a219e">tempest-ServerActionsTestOtherA-1600580756-project-member</nova:user>
Aug 26 20:45:26 user nova-compute[73476]:         <nova:project uuid="b16d8f644f0442fea1f8a57961111a30">tempest-ServerActionsTestOtherA-1600580756</nova:project>
Aug 26 20:45:26 user nova-compute[73476]:       </nova:owner>
Aug 26 20:45:26 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:45:26 user nova-compute[73476]:       <nova:ports>
Aug 26 20:45:26 user nova-compute[73476]:         <nova:port uuid="920e6ff4-145c-41b3-b513-49437e60144b">
Aug 26 20:45:26 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 20:45:26 user nova-compute[73476]:         </nova:port>
Aug 26 20:45:26 user nova-compute[73476]:       </nova:ports>
Aug 26 20:45:26 user nova-compute[73476]:     </nova:instance>
Aug 26 20:45:26 user nova-compute[73476]:   </metadata>
Aug 26 20:45:26 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:45:26 user nova-compute[73476]:     <system>
Aug 26 20:45:26 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:45:26 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:45:26 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:45:26 user nova-compute[73476]:       <entry name="serial">eaf9f058-2194-4e0e-9460-328108758c42</entry>
Aug 26 20:45:26 user nova-compute[73476]:       <entry name="uuid">eaf9f058-2194-4e0e-9460-328108758c42</entry>
Aug 26 20:45:26 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:45:26 user nova-compute[73476]:     </system>
Aug 26 20:45:26 user nova-compute[73476]:   </sysinfo>
Aug 26 20:45:26 user nova-compute[73476]:   <os>
Aug 26 20:45:26 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:45:26 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:45:26 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:45:26 user nova-compute[73476]:   </os>
Aug 26 20:45:26 user nova-compute[73476]:   <features>
Aug 26 20:45:26 user nova-compute[73476]:     <acpi/>
Aug 26 20:45:26 user nova-compute[73476]:     <apic/>
Aug 26 20:45:26 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:45:26 user nova-compute[73476]:   </features>
Aug 26 20:45:26 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:45:26 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:45:26 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:45:26 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:45:26 user nova-compute[73476]:   </clock>
Aug 26 20:45:26 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:45:26 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:45:26 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:45:26 user nova-compute[73476]:   </cpu>
Aug 26 20:45:26 user nova-compute[73476]:   <devices>
Aug 26 20:45:26 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:45:26 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:45:26 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk"/>
Aug 26 20:45:26 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:45:26 user nova-compute[73476]:     </disk>
Aug 26 20:45:26 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:45:26 user nova-compute[73476]:       <mac address="fa:16:3e:1c:de:05"/>
Aug 26 20:45:26 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:45:26 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:45:26 user nova-compute[73476]:       <target dev="tap920e6ff4-14"/>
Aug 26 20:45:26 user nova-compute[73476]:     </interface>
Aug 26 20:45:26 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:45:26 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/console.log" append="off"/>
Aug 26 20:45:26 user nova-compute[73476]:     </serial>
Aug 26 20:45:26 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:45:26 user nova-compute[73476]:     <video>
Aug 26 20:45:26 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:45:26 user nova-compute[73476]:     </video>
Aug 26 20:45:26 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:45:26 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:45:26 user nova-compute[73476]:     </rng>
Aug 26 20:45:26 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:45:26 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:45:26 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:45:26 user nova-compute[73476]:     </memballoon>
Aug 26 20:45:26 user nova-compute[73476]:   </devices>
Aug 26 20:45:26 user nova-compute[73476]: </domain>
Aug 26 20:45:26 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-924396',display_name='tempest-tempest.common.compute-instance-924396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-924396',id=14,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV/yd8kfxlaTWXrDZ3wbLsadxJe1f2WQOA3s+97nsG/XDorWSKUuwbAAV+UBcfNkZOqvbKg3jvF1sQHB2BfsglNHCVhOpK2aXH6Iq8Qok+VhT6HbE2h3S1fpQjHJ8cjDw==',key_name='tempest-keypair-710174093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-qgortcq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:45:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=eaf9f058-2194-4e0e-9460-328108758c42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG os_vif [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap920e6ff4-14, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap920e6ff4-14, col_values=(('external_ids', {'iface-id': '920e6ff4-145c-41b3-b513-49437e60144b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:de:05', 'vm-uuid': 'eaf9f058-2194-4e0e-9460-328108758c42'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:26 user nova-compute[73476]: INFO os_vif [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14')
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No VIF found with MAC fa:16:3e:1c:de:05, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-ce3d4660-cf69-4694-8187-cda5d099cbdd req-e0031cb0-a4e2-4d83-b296-448c270127de service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-changed-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-ce3d4660-cf69-4694-8187-cda5d099cbdd req-e0031cb0-a4e2-4d83-b296-448c270127de service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Refreshing instance network info cache due to event network-changed-920e6ff4-145c-41b3-b513-49437e60144b. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ce3d4660-cf69-4694-8187-cda5d099cbdd req-e0031cb0-a4e2-4d83-b296-448c270127de service nova] Acquiring lock "refresh_cache-eaf9f058-2194-4e0e-9460-328108758c42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ce3d4660-cf69-4694-8187-cda5d099cbdd req-e0031cb0-a4e2-4d83-b296-448c270127de service nova] Acquired lock "refresh_cache-eaf9f058-2194-4e0e-9460-328108758c42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:45:26 user nova-compute[73476]: DEBUG nova.network.neutron [req-ce3d4660-cf69-4694-8187-cda5d099cbdd req-e0031cb0-a4e2-4d83-b296-448c270127de service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Refreshing network info cache for port 920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:45:27 user nova-compute[73476]: DEBUG nova.network.neutron [req-ce3d4660-cf69-4694-8187-cda5d099cbdd req-e0031cb0-a4e2-4d83-b296-448c270127de service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Updated VIF entry in instance network info cache for port 920e6ff4-145c-41b3-b513-49437e60144b. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:45:27 user nova-compute[73476]: DEBUG nova.network.neutron [req-ce3d4660-cf69-4694-8187-cda5d099cbdd req-e0031cb0-a4e2-4d83-b296-448c270127de service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Updating instance_info_cache with network_info: [{"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ce3d4660-cf69-4694-8187-cda5d099cbdd req-e0031cb0-a4e2-4d83-b296-448c270127de service nova] Releasing lock "refresh_cache-eaf9f058-2194-4e0e-9460-328108758c42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:45:27 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:28 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:28 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:28 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-6c4e841d-fa78-43a0-81ab-d252d64fd1de req-107607de-5d77-4136-9196-7e5e415c5882 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6c4e841d-fa78-43a0-81ab-d252d64fd1de req-107607de-5d77-4136-9196-7e5e415c5882 service nova] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6c4e841d-fa78-43a0-81ab-d252d64fd1de req-107607de-5d77-4136-9196-7e5e415c5882 service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6c4e841d-fa78-43a0-81ab-d252d64fd1de req-107607de-5d77-4136-9196-7e5e415c5882 service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-6c4e841d-fa78-43a0-81ab-d252d64fd1de req-107607de-5d77-4136-9196-7e5e415c5882 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] No waiting events found dispatching network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:29 user nova-compute[73476]: WARNING nova.compute.manager [req-6c4e841d-fa78-43a0-81ab-d252d64fd1de req-107607de-5d77-4136-9196-7e5e415c5882 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received unexpected event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b for instance with vm_state building and task_state spawning.
Aug 26 20:45:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082730.6746175, eaf9f058-2194-4e0e-9460-328108758c42 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:45:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] VM Resumed (Lifecycle Event)
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:45:30 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Instance spawned successfully.
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:45:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082730.6766272, eaf9f058-2194-4e0e-9460-328108758c42 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:45:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] VM Started (Lifecycle Event)
Aug 26 20:45:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:45:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:45:30 user nova-compute[73476]: INFO nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Took 7.33 seconds to spawn the instance on the hypervisor.
Aug 26 20:45:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:45:30 user nova-compute[73476]: INFO nova.compute.manager [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Took 8.86 seconds to build instance.
Aug 26 20:45:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2bd05ca1-554b-4922-828c-7e233357e363 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.074s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG nova.compute.manager [req-0b151b5f-288f-48ac-8e9e-761d48fb77bb req-cc8cba0d-4fef-41fd-97ce-945da7b465f0 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0b151b5f-288f-48ac-8e9e-761d48fb77bb req-cc8cba0d-4fef-41fd-97ce-945da7b465f0 service nova] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0b151b5f-288f-48ac-8e9e-761d48fb77bb req-cc8cba0d-4fef-41fd-97ce-945da7b465f0 service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0b151b5f-288f-48ac-8e9e-761d48fb77bb req-cc8cba0d-4fef-41fd-97ce-945da7b465f0 service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG nova.compute.manager [req-0b151b5f-288f-48ac-8e9e-761d48fb77bb req-cc8cba0d-4fef-41fd-97ce-945da7b465f0 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] No waiting events found dispatching network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:31 user nova-compute[73476]: WARNING nova.compute.manager [req-0b151b5f-288f-48ac-8e9e-761d48fb77bb req-cc8cba0d-4fef-41fd-97ce-945da7b465f0 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received unexpected event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b for instance with vm_state active and task_state None.
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:32 user nova-compute[73476]: INFO nova.compute.manager [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Terminating instance
Aug 26 20:45:32 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-e3779e50-6aac-4b08-86d2-72a855ca0887 req-1ced33a1-1d4a-440d-a7ce-b10066062062 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received event network-vif-unplugged-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e3779e50-6aac-4b08-86d2-72a855ca0887 req-1ced33a1-1d4a-440d-a7ce-b10066062062 service nova] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e3779e50-6aac-4b08-86d2-72a855ca0887 req-1ced33a1-1d4a-440d-a7ce-b10066062062 service nova] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e3779e50-6aac-4b08-86d2-72a855ca0887 req-1ced33a1-1d4a-440d-a7ce-b10066062062 service nova] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-e3779e50-6aac-4b08-86d2-72a855ca0887 req-1ced33a1-1d4a-440d-a7ce-b10066062062 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] No waiting events found dispatching network-vif-unplugged-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-e3779e50-6aac-4b08-86d2-72a855ca0887 req-1ced33a1-1d4a-440d-a7ce-b10066062062 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received event network-vif-unplugged-4ebaad24-c622-4e30-813a-3566c5edaeca for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Instance destroyed successfully.
Aug 26 20:45:33 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lazy-loading 'resources' on Instance uuid ee7cf32f-71c2-49ca-8a23-51fc95560974 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1159189828',display_name='tempest-VolumesAssistedSnapshotsTest-server-1159189828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1159189828',id=10,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDUPXj1AzfuxIeAIXOrpyqOf8irHPw2suFNDl4usSO3Rg4jYxe+UpJDqioZSRsORZFn9JGZ86v086OFvmjxXXReyupJ5DSE60kvoVSEu10g1R4O5jijqqGO56AgRabE7w==',key_name='tempest-keypair-858740917',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5d881ed25ae4e62a56d5da0c7edeab3',ramdisk_id='',reservation_id='r-g3r5kzyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1739682517',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1739682517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741297cb47d6480381ad5522fd177412',uuid=ee7cf32f-71c2-49ca-8a23-51fc95560974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Converting VIF {"id": "4ebaad24-c622-4e30-813a-3566c5edaeca", "address": "fa:16:3e:e3:98:32", "network": {"id": "5dae46ca-c114-483d-ba07-c88a483182d7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624638083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d881ed25ae4e62a56d5da0c7edeab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ebaad24-c6", "ovs_interfaceid": "4ebaad24-c622-4e30-813a-3566c5edaeca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:98:32,bridge_name='br-int',has_traffic_filtering=True,id=4ebaad24-c622-4e30-813a-3566c5edaeca,network=Network(5dae46ca-c114-483d-ba07-c88a483182d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebaad24-c6') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG os_vif [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:98:32,bridge_name='br-int',has_traffic_filtering=True,id=4ebaad24-c622-4e30-813a-3566c5edaeca,network=Network(5dae46ca-c114-483d-ba07-c88a483182d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebaad24-c6') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ebaad24-c6, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:33 user nova-compute[73476]: INFO os_vif [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:98:32,bridge_name='br-int',has_traffic_filtering=True,id=4ebaad24-c622-4e30-813a-3566c5edaeca,network=Network(5dae46ca-c114-483d-ba07-c88a483182d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ebaad24-c6')
Aug 26 20:45:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Deleting instance files /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974_del
Aug 26 20:45:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Deletion of /opt/stack/data/nova/instances/ee7cf32f-71c2-49ca-8a23-51fc95560974_del complete
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:33 user nova-compute[73476]: INFO nova.compute.manager [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 20:45:33 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:45:33 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-3a115aeb-3d22-426a-9c2d-bd74e41c91b5 req-4e9c2fab-a493-4487-be15-92228f9f8f3c service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received event network-vif-deleted-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:35 user nova-compute[73476]: INFO nova.compute.manager [req-3a115aeb-3d22-426a-9c2d-bd74e41c91b5 req-4e9c2fab-a493-4487-be15-92228f9f8f3c service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Neutron deleted interface 4ebaad24-c622-4e30-813a-3566c5edaeca; detaching it from the instance and deleting it from the info cache
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.network.neutron [req-3a115aeb-3d22-426a-9c2d-bd74e41c91b5 req-4e9c2fab-a493-4487-be15-92228f9f8f3c service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:35 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Took 1.29 seconds to deallocate network for instance.
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-3a115aeb-3d22-426a-9c2d-bd74e41c91b5 req-4e9c2fab-a493-4487-be15-92228f9f8f3c service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Detach interface failed, port_id=4ebaad24-c622-4e30-813a-3566c5edaeca, reason: Instance ee7cf32f-71c2-49ca-8a23-51fc95560974 could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-259ed62d-9dd5-423e-b4d1-779ea6499b4f req-84b0bf2f-2ec5-468b-b492-f19fb1160aa3 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received event network-vif-plugged-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-259ed62d-9dd5-423e-b4d1-779ea6499b4f req-84b0bf2f-2ec5-468b-b492-f19fb1160aa3 service nova] Acquiring lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-259ed62d-9dd5-423e-b4d1-779ea6499b4f req-84b0bf2f-2ec5-468b-b492-f19fb1160aa3 service nova] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-259ed62d-9dd5-423e-b4d1-779ea6499b4f req-84b0bf2f-2ec5-468b-b492-f19fb1160aa3 service nova] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-259ed62d-9dd5-423e-b4d1-779ea6499b4f req-84b0bf2f-2ec5-468b-b492-f19fb1160aa3 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] No waiting events found dispatching network-vif-plugged-4ebaad24-c622-4e30-813a-3566c5edaeca {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:35 user nova-compute[73476]: WARNING nova.compute.manager [req-259ed62d-9dd5-423e-b4d1-779ea6499b4f req-84b0bf2f-2ec5-468b-b492-f19fb1160aa3 service nova] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Received unexpected event network-vif-plugged-4ebaad24-c622-4e30-813a-3566c5edaeca for instance with vm_state deleted and task_state None.
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:45:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.617s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:36 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Deleted allocations for instance ee7cf32f-71c2-49ca-8a23-51fc95560974
Aug 26 20:45:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f45872aa-9884-428d-af27-ec2b61163b38 tempest-VolumesAssistedSnapshotsTest-1739682517 tempest-VolumesAssistedSnapshotsTest-1739682517-project-member] Lock "ee7cf32f-71c2-49ca-8a23-51fc95560974" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.918s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:36 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:45:36 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=7312MB free_disk=25.569053649902344GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ad42cf47-42fb-488f-a44f-cf9824dd4d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22c72de3-e06b-4aae-bed9-162101a43e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e9309346-2675-4bfd-9781-175b9b40d71e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 5160d9ff-3e26-4743-8e34-ebae9fd95f8b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance eaf9f058-2194-4e0e-9460-328108758c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:45:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:45:37 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:45:37 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:45:37 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:45:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.838s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:37 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082722.720847, 8150e248-6046-4d1e-bb7c-3b94cd6d30e5 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:45:37 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] VM Stopped (Lifecycle Event)
Aug 26 20:45:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13b1c381-c8c6-4f77-9654-287a97fac878 None None] [instance: 8150e248-6046-4d1e-bb7c-3b94cd6d30e5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:45:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:45:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:45:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:45:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:45:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:45:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:40 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:40 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:40 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1facdd-3acc-4bb9-931c-3699bc780a6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:45:40 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c457cad4-01b5-420d-ad2b-13fd953b3d0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2] added
Aug 26 20:45:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0220b5-cea0-459e-9062-04c4cd895869]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Updating instance_info_cache with network_info: [{"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b804b4c-d414-4bf5-9203-f29b389a548b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDcINFvz {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDcINFvz" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eefd1f5-a252-4623-b954-19bc808c6bfd]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uDcINFvz'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b612b9c-c705-47bc-b397-3740bc001c19]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b3412d-c512-4158-8a47-495b3f2c88cc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[325135bb-27db-48d3-a325-dca4daf718ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]
Aug 26 20:45:40 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.
Aug 26 20:45:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aac60c3-4f29-4503-9abf-52720e4b28e4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e298b047-f0f1-450c-9bbe-46bfec04c1b6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:40 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff94c716-a51a-4c9b-836a-8e220bd61add]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:45:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:45:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23838373138666163', 'path': '/dev/sde'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838373138666163', 'path': '/dev/sde'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:45:41 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lazy-loading 'flavor' on Instance uuid ad42cf47-42fb-488f-a44f-cf9824dd4d99 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:45:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:45:42 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:45:42 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:45:42 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:45:42 user nova-compute[73476]:   <serial>8809a5b6-d0f3-4f59-b94e-220073f5f4c2</serial>
Aug 26 20:45:42 user nova-compute[73476]: </disk>
Aug 26 20:45:42 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:45:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:45:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:45:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] No VIF found with MAC fa:16:3e:65:28:58, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:45:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f6e474-3116-486e-8c8c-be29c67be2e1 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.897s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-89cee05b-e33f-41c8-852d-4e8ef2e8170c req-09726eb1-ef8c-424a-8cfe-5f013e06f3c8 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-changed-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-89cee05b-e33f-41c8-852d-4e8ef2e8170c req-09726eb1-ef8c-424a-8cfe-5f013e06f3c8 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing instance network info cache due to event network-changed-a1a7a9b5-7aa3-42d6-ab15-63bc93963079. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:45:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-89cee05b-e33f-41c8-852d-4e8ef2e8170c req-09726eb1-ef8c-424a-8cfe-5f013e06f3c8 service nova] Acquiring lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:45:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-89cee05b-e33f-41c8-852d-4e8ef2e8170c req-09726eb1-ef8c-424a-8cfe-5f013e06f3c8 service nova] Acquired lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:45:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-89cee05b-e33f-41c8-852d-4e8ef2e8170c req-09726eb1-ef8c-424a-8cfe-5f013e06f3c8 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Refreshing network info cache for port a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:45:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:44 user nova-compute[73476]: DEBUG nova.network.neutron [req-89cee05b-e33f-41c8-852d-4e8ef2e8170c req-09726eb1-ef8c-424a-8cfe-5f013e06f3c8 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updated VIF entry in instance network info cache for port a1a7a9b5-7aa3-42d6-ab15-63bc93963079. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:45:44 user nova-compute[73476]: DEBUG nova.network.neutron [req-89cee05b-e33f-41c8-852d-4e8ef2e8170c req-09726eb1-ef8c-424a-8cfe-5f013e06f3c8 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [{"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-89cee05b-e33f-41c8-852d-4e8ef2e8170c req-09726eb1-ef8c-424a-8cfe-5f013e06f3c8 service nova] Releasing lock "refresh_cache-5160d9ff-3e26-4743-8e34-ebae9fd95f8b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:45:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Stashing vm_state: active {{(pid=73476) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:45:46 user nova-compute[73476]: INFO nova.compute.claims [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Claim successful on node user
Aug 26 20:45:46 user nova-compute[73476]: INFO nova.compute.resource_tracker [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating resource usage from migration 1c6495dd-42aa-4c60-8ef3-a8b581a384c7
Aug 26 20:45:46 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.600s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:46 user nova-compute[73476]: INFO nova.compute.manager [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Migrating
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:45:46 user nova-compute[73476]: INFO nova.compute.rpcapi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquired lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:46 user nova-compute[73476]: INFO nova.compute.manager [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Terminating instance
Aug 26 20:45:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG nova.network.neutron [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance_info_cache with network_info: [{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Releasing lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Starting migrate_disk_and_power_off {{(pid=73476) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-c4c2aa82-e7ea-4e33-afff-d6c2dd1d842a req-dd5888ca-9f09-40c8-b6e6-88b9b94ddfcf service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c4c2aa82-e7ea-4e33-afff-d6c2dd1d842a req-dd5888ca-9f09-40c8-b6e6-88b9b94ddfcf service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c4c2aa82-e7ea-4e33-afff-d6c2dd1d842a req-dd5888ca-9f09-40c8-b6e6-88b9b94ddfcf service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c4c2aa82-e7ea-4e33-afff-d6c2dd1d842a req-dd5888ca-9f09-40c8-b6e6-88b9b94ddfcf service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-c4c2aa82-e7ea-4e33-afff-d6c2dd1d842a req-dd5888ca-9f09-40c8-b6e6-88b9b94ddfcf service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-unplugged-39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-c4c2aa82-e7ea-4e33-afff-d6c2dd1d842a req-dd5888ca-9f09-40c8-b6e6-88b9b94ddfcf service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-39bca6ec-db93-4751-aae8-459cb1493eff for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-25490d56-c91a-43ab-a1e0-32f3698bac25 req-f17a877a-3112-4ea6-b076-1b57d32d5929 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-25490d56-c91a-43ab-a1e0-32f3698bac25 req-f17a877a-3112-4ea6-b076-1b57d32d5929 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-25490d56-c91a-43ab-a1e0-32f3698bac25 req-f17a877a-3112-4ea6-b076-1b57d32d5929 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-25490d56-c91a-43ab-a1e0-32f3698bac25 req-f17a877a-3112-4ea6-b076-1b57d32d5929 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-25490d56-c91a-43ab-a1e0-32f3698bac25 req-f17a877a-3112-4ea6-b076-1b57d32d5929 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-unplugged-f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-25490d56-c91a-43ab-a1e0-32f3698bac25 req-f17a877a-3112-4ea6-b076-1b57d32d5929 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-f52cf477-0f53-45ee-81ec-9c167df18045 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082733.562717, ee7cf32f-71c2-49ca-8a23-51fc95560974 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:45:48 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] VM Stopped (Lifecycle Event)
Aug 26 20:45:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-405580bc-0470-479d-9a7a-4eedf6234c1e None None] [instance: ee7cf32f-71c2-49ca-8a23-51fc95560974] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance destroyed successfully.
Aug 26 20:45:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-263678955',display_name='tempest-ServerActionsTestOtherB-server-263678955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-263678955',id=5,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6duovOgpoS/+TE0EH/fCNy+ilV5kxrulfvMaTJVTAkoOJVt3B0olv0pH7NT01fhQF+CMU3wUX3bGKgX/wKj8M/GNeOdqt2EwZ91VfdEmDAANieG8njlOp1SAEmAi7Ug==',key_name='tempest-keypair-1212818177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76a9f74cd94849f7a132c168b1ed5622',ramdisk_id='',reservation_id='r-ns6go6pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-42689020',owner_user_name='tempest-ServerActionsTestOtherB-42689020-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18713e0a843f45f08cdb8d70e7cafeeb',uuid=ad42cf47-42fb-488f-a44f-cf9824dd4d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-111688451-network", "vif_mac": "fa:16:3e:65:28:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converting VIF {"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-111688451-network", "vif_mac": "fa:16:3e:65:28:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG os_vif [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0b59e8a-19, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:48 user nova-compute[73476]: INFO os_vif [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19')
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:49 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c331ea-a781-4d10-aa02-95ac74892370]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.059s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ea5a45-ebd3-4e0e-8d70-01b85f28bffa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b0291d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'): ({'sde'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Removing single pathed devices sde {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2318653-960b-4da5-b5b8-e411154502ff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.035s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ffb85e-8b66-47ea-b747-aea00ce3343e]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Flushing IO for device /dev/sde {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f1851d-e473-45ca-a3d8-2f48095fbe06]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Instance destroyed successfully.
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.objects.instance [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lazy-loading 'resources' on Instance uuid 5160d9ff-3e26-4743-8e34-ebae9fd95f8b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "address": "fa:16:3e:d4:79:f0", "network": {"id": "954ab838-7f53-4d47-a414-b2cd4cfe696b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1166079145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1a7a9b5-7a", "ovs_interfaceid": "a1a7a9b5-7aa3-42d6-ab15-63bc93963079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:79:f0,bridge_name='br-int',has_traffic_filtering=True,id=a1a7a9b5-7aa3-42d6-ab15-63bc93963079,network=Network(954ab838-7f53-4d47-a414-b2cd4cfe696b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1a7a9b5-7a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:79:f0,bridge_name='br-int',has_traffic_filtering=True,id=a1a7a9b5-7aa3-42d6-ab15-63bc93963079,network=Network(954ab838-7f53-4d47-a414-b2cd4cfe696b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1a7a9b5-7a') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1a7a9b5-7a, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.067s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e012baa1-cc5e-4129-a888-aefe0bc58857]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1a825e27-88718face854ec4b', '/dev/disk/by-id/scsi-23838373138666163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1a825e27') {{(pid=84820) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c615831d-35e4-410c-affb-0871ab383b2f]: (4, None) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc0772c-91fc-4dea-aebb-17af09310e0f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: INFO os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:79:f0,bridge_name='br-int',has_traffic_filtering=True,id=a1a7a9b5-7aa3-42d6-ab15-63bc93963079,network=Network(954ab838-7f53-4d47-a414-b2cd4cfe696b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1a7a9b5-7a')
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e3:f9,bridge_name='br-int',has_traffic_filtering=True,id=f52cf477-0f53-45ee-81ec-9c167df18045,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf52cf477-0f') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e3:f9,bridge_name='br-int',has_traffic_filtering=True,id=f52cf477-0f53-45ee-81ec-9c167df18045,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf52cf477-0f') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf52cf477-0f, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: INFO os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e3:f9,bridge_name='br-int',has_traffic_filtering=True,id=f52cf477-0f53-45ee-81ec-9c167df18045,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf52cf477-0f')
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=39bca6ec-db93-4751-aae8-459cb1493eff,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39bca6ec-db') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=39bca6ec-db93-4751-aae8-459cb1493eff,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39bca6ec-db') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a477ef-6a28-4642-aa60-9577558eb451]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]
Aug 26 20:45:49 user nova-compute[73476]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.
Aug 26 20:45:49 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39bca6ec-db, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb210df-9707-491f-9cb5-503fa8c91582]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.504s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] <== disconnect_volume: return (507ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: INFO os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:3c,bridge_name='br-int',has_traffic_filtering=True,id=39bca6ec-db93-4751-aae8-459cb1493eff,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap39bca6ec-db')
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=63514087-bf1a-4562-bc47-5d4f2ee425e6,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63514087-bf') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=63514087-bf1a-4562-bc47-5d4f2ee425e6,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63514087-bf') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63514087-bf, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:49 user nova-compute[73476]: INFO os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=63514087-bf1a-4562-bc47-5d4f2ee425e6,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63514087-bf')
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c5:a9,bridge_name='br-int',has_traffic_filtering=True,id=4894df4f-d1e9-4349-9669-0e21ac0d13fd,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4894df4f-d1') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c5:a9,bridge_name='br-int',has_traffic_filtering=True,id=4894df4f-d1e9-4349-9669-0e21ac0d13fd,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4894df4f-d1') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4894df4f-d1, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: INFO os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c5:a9,bridge_name='br-int',has_traffic_filtering=True,id=4894df4f-d1e9-4349-9669-0e21ac0d13fd,network=Network(dc089e91-dc91-438e-991a-961e03194bed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4894df4f-d1')
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=2014bb91-a4f9-4e38-bf19-164a3ec7b1a4,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2014bb91-a4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=2014bb91-a4f9-4e38-bf19-164a3ec7b1a4,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2014bb91-a4') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2014bb91-a4, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: INFO os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:14:bf,bridge_name='br-int',has_traffic_filtering=True,id=2014bb91-a4f9-4e38-bf19-164a3ec7b1a4,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2014bb91-a4')
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1390994485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1390994485',id=11,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUlqFPW6Kx4I3rg0tgYmmcePLm0LwSeygZFqTYLJXRjJhNGw4Vlwhni55nBmY7WDpX3dqu4dX8MUCG1VVeUimDtUnJdtLIw40yWcBx6elseXMR5STEdKTK/BDUi8s9D+Q==',key_name='tempest-keypair-868314776',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee51467d38d14f2d94d0a172d75d03bc',ramdisk_id='',reservation_id='r-hmf2pqkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1367414827',owner_user_name='tempest-TaggedBootDevicesTest_v242-1367414827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea7080831dda481c8f964e501e6037c5',uuid=5160d9ff-3e26-4743-8e34-ebae9fd95f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converting VIF {"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:c6,bridge_name='br-int',has_traffic_filtering=True,id=0d363dad-ebd2-4894-ba7c-586441bb567f,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d363dad-eb') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:c6,bridge_name='br-int',has_traffic_filtering=True,id=0d363dad-ebd2-4894-ba7c-586441bb567f,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d363dad-eb') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d363dad-eb, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:49 user nova-compute[73476]: INFO os_vif [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:c6,bridge_name='br-int',has_traffic_filtering=True,id=0d363dad-ebd2-4894-ba7c-586441bb567f,network=Network(08249589-3015-4e29-8f99-e1777e08a2fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d363dad-eb')
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stdHwCgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:49 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c3600f-0266-447f-8252-8c8bf85d65c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[760609ec-32ab-48fe-a4e9-3026fb90fd16]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:49 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:49 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b0290d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e1c68c-a700-4bbd-9807-e215b42ed360]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abee376-97ca-4c3f-acf5-fd62f0958990]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0101d41-d0ad-418d-9b10-0ba399c86e47]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a0a81c-a04e-4471-82f3-d3d6b1586c01]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[65931141-54a7-4414-a721-e6f5509118e7]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:45:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99_resize/disk /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-39bca6ec-db93-4751-aae8-459cb1493eff {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:50 user nova-compute[73476]: WARNING nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-39bca6ec-db93-4751-aae8-459cb1493eff for instance with vm_state active and task_state deleting.
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-unplugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:50 user nova-compute[73476]: WARNING nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-63514087-bf1a-4562-bc47-5d4f2ee425e6 for instance with vm_state active and task_state deleting.
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-unplugged-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-0d363dad-ebd2-4894-ba7c-586441bb567f for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:50 user nova-compute[73476]: WARNING nova.compute.manager [req-433e2c3a-87ea-456f-adb5-bdb7d0675311 req-2ebd81b4-bd07-4919-85b7-e33b01b3c341 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-0d363dad-ebd2-4894-ba7c-586441bb567f for instance with vm_state active and task_state deleting.
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-4164c32b-1d0b-4841-956f-a0499634e072 req-9b100ffe-975d-4e07-bc75-22ca29eb5e70 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4164c32b-1d0b-4841-956f-a0499634e072 req-9b100ffe-975d-4e07-bc75-22ca29eb5e70 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4164c32b-1d0b-4841-956f-a0499634e072 req-9b100ffe-975d-4e07-bc75-22ca29eb5e70 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4164c32b-1d0b-4841-956f-a0499634e072 req-9b100ffe-975d-4e07-bc75-22ca29eb5e70 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-4164c32b-1d0b-4841-956f-a0499634e072 req-9b100ffe-975d-4e07-bc75-22ca29eb5e70 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-unplugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-4164c32b-1d0b-4841-956f-a0499634e072 req-9b100ffe-975d-4e07-bc75-22ca29eb5e70 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[55936887-edb5-4e3c-8137-bbd74b8a3312]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7, portal: 172.16.0.220,3260]
Aug 26 20:45:50 user nova-compute[73476]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7, portal: 172.16.0.220,3260] successful.
Aug 26 20:45:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7d6789-4bd2-4d01-a2f4-d2a94e81e6b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2da40b-2471-4499-883d-4115ae4c008d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] <== disconnect_volume: return (411ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZJHixWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:50 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[084f0eb1-819e-4f39-95dc-0432e92ad5d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-d32e09f8-61aa-44a7-800b-55f32477b69a req-95728a48-aed0-4e9c-b0d4-d4a05cf3acba service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d32e09f8-61aa-44a7-800b-55f32477b69a req-95728a48-aed0-4e9c-b0d4-d4a05cf3acba service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d32e09f8-61aa-44a7-800b-55f32477b69a req-95728a48-aed0-4e9c-b0d4-d4a05cf3acba service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d32e09f8-61aa-44a7-800b-55f32477b69a req-95728a48-aed0-4e9c-b0d4-d4a05cf3acba service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-d32e09f8-61aa-44a7-800b-55f32477b69a req-95728a48-aed0-4e9c-b0d4-d4a05cf3acba service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-f52cf477-0f53-45ee-81ec-9c167df18045 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:50 user nova-compute[73476]: WARNING nova.compute.manager [req-d32e09f8-61aa-44a7-800b-55f32477b69a req-95728a48-aed0-4e9c-b0d4-d4a05cf3acba service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-f52cf477-0f53-45ee-81ec-9c167df18045 for instance with vm_state active and task_state deleting.
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50dd81c-8a09-442a-ae65-e206d8af0d33]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:50 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:50 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:50 user nova-compute[73476]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d (non-flash)
Aug 26 20:45:50 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02909d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ea08cd-fffd-4051-b950-cd3a3e62f1a5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f12cf17-ae84-4f00-b28b-f2d81ef76ecc]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab76d35-a820-4e11-a5b3-7342c3f692ee]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "cp -r /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99_resize/disk /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk" returned: 0 in 0.341s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99_resize/disk.info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk.info {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34dcf72-da01-4df8-a8d3-870ab229e768]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "cp -r /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99_resize/disk.info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk.info" returned: 0 in 0.044s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[677b535b-36c6-4922-b6c0-810f34f3b828]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6ea90a-056d-4d59-bfe6-bf9d19d34cdf]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d, portal: 172.16.0.220,3260]
Aug 26 20:45:50 user nova-compute[73476]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d, portal: 172.16.0.220,3260] successful.
Aug 26 20:45:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f72e6e2a-f102-4cb0-9816-192f6763bf1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[244752b8-7c57-40b8-b32f-89880d6dace9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] <== disconnect_volume: return (372ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHBQADsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:50 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2930bf81-dedf-4184-9b32-19edc134f871]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[54684cb3-0114-402e-9418-259eeea26d23]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:50 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:45:50 user nova-compute[73476]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 (non-flash)
Aug 26 20:45:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02a39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50'): ({'sdd'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Removing single pathed devices sdd {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bea7cfe-89f9-4c0a-b6d3-81843ab77b67]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2695f190-1339-4247-af60-84bb80cde332]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Flushing IO for device /dev/sdd {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6ee102-8691-48c0-9f23-0c8f8549cb9b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a057cede-cc9c-466c-b196-cd8d6b50cf08]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[af55eaf6-9855-4f0b-9bab-dc3033f20e50]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7814784f-e1f4-47b5-9517-f240eb70b160]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50, portal: 172.16.0.220,3260]
Aug 26 20:45:50 user nova-compute[73476]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50, portal: 172.16.0.220,3260] successful.
Aug 26 20:45:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:037f4410-54f5-490f-a088-57d89b2e1f50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84e0fac-6108-4999-9277-d800f159c190]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] <== disconnect_volume: return (319ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:45:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Deleting instance files /opt/stack/data/nova/instances/5160d9ff-3e26-4743-8e34-ebae9fd95f8b_del
Aug 26 20:45:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Deletion of /opt/stack/data/nova/instances/5160d9ff-3e26-4743-8e34-ebae9fd95f8b_del complete
Aug 26 20:45:50 user nova-compute[73476]: INFO nova.compute.manager [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Took 3.92 seconds to destroy the instance on the hypervisor.
Aug 26 20:45:50 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:45:50 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-unplugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:52 user nova-compute[73476]: WARNING nova.compute.manager [req-d3562db2-9c34-42f1-a337-e3a8535ba668 req-a21fae80-7405-4f9b-8234-920db8285d53 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 for instance with vm_state active and task_state deleting.
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:52 user nova-compute[73476]: WARNING nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 for instance with vm_state active and task_state deleting.
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-unplugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-unplugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-plugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Acquiring lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] No waiting events found dispatching network-vif-plugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:52 user nova-compute[73476]: WARNING nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received unexpected event network-vif-plugged-4894df4f-d1e9-4349-9669-0e21ac0d13fd for instance with vm_state active and task_state deleting.
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-unplugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-unplugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:52 user nova-compute[73476]: WARNING nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-unplugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state active and task_state resize_migrating.
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:45:52 user nova-compute[73476]: WARNING nova.compute.manager [req-602defd7-444b-429e-8bc9-0fb93c57f0b6 req-63b6a44f-69fb-4f75-b667-56c602983260 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state active and task_state resize_migrating.
Aug 26 20:45:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-35b5f392-3e48-4bd1-84bc-98ea535a8f8f req-32cfa137-927c-4f8d-86ee-bc1fbd4c476c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-deleted-a1a7a9b5-7aa3-42d6-ab15-63bc93963079 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:55 user nova-compute[73476]: INFO nova.compute.manager [req-35b5f392-3e48-4bd1-84bc-98ea535a8f8f req-32cfa137-927c-4f8d-86ee-bc1fbd4c476c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Neutron deleted interface a1a7a9b5-7aa3-42d6-ab15-63bc93963079; detaching it from the instance and deleting it from the info cache
Aug 26 20:45:55 user nova-compute[73476]: DEBUG nova.network.neutron [req-35b5f392-3e48-4bd1-84bc-98ea535a8f8f req-32cfa137-927c-4f8d-86ee-bc1fbd4c476c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [{"id": "f52cf477-0f53-45ee-81ec-9c167df18045", "address": "fa:16:3e:19:e3:f9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52cf477-0f", "ovs_interfaceid": "f52cf477-0f53-45ee-81ec-9c167df18045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "39bca6ec-db93-4751-aae8-459cb1493eff", "address": "fa:16:3e:90:40:3c", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bca6ec-db", "ovs_interfaceid": "39bca6ec-db93-4751-aae8-459cb1493eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "address": "fa:16:3e:7d:cf:74", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63514087-bf", "ovs_interfaceid": "63514087-bf1a-4562-bc47-5d4f2ee425e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "address": "fa:16:3e:d1:c5:a9", "network": {"id": "dc089e91-dc91-438e-991a-961e03194bed", "bridge": "br-int", "label": "tempest-device-tagging-net1-1494408969", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4894df4f-d1", "ovs_interfaceid": "4894df4f-d1e9-4349-9669-0e21ac0d13fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "address": "fa:16:3e:41:14:bf", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2014bb91-a4", "ovs_interfaceid": "2014bb91-a4f9-4e38-bf19-164a3ec7b1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d363dad-ebd2-4894-ba7c-586441bb567f", "address": "fa:16:3e:6d:45:c6", "network": {"id": "08249589-3015-4e29-8f99-e1777e08a2fe", "bridge": "br-int", "label": "tempest-device-tagging-net2-1502518575", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ee51467d38d14f2d94d0a172d75d03bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d363dad-eb", "ovs_interfaceid": "0d363dad-ebd2-4894-ba7c-586441bb567f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-35b5f392-3e48-4bd1-84bc-98ea535a8f8f req-32cfa137-927c-4f8d-86ee-bc1fbd4c476c service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Detach interface failed, port_id=a1a7a9b5-7aa3-42d6-ab15-63bc93963079, reason: Instance 5160d9ff-3e26-4743-8e34-ebae9fd95f8b could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:45:56 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:56 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Took 5.95 seconds to deallocate network for instance.
Aug 26 20:45:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-0e1a947b-2e97-415a-a2a4-02196f9e1c85 req-47a57ac2-907d-4dec-87a0-ddd779bee2ae service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-deleted-2014bb91-a4f9-4e38-bf19-164a3ec7b1a4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-0e1a947b-2e97-415a-a2a4-02196f9e1c85 req-47a57ac2-907d-4dec-87a0-ddd779bee2ae service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-deleted-0d363dad-ebd2-4894-ba7c-586441bb567f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-0e1a947b-2e97-415a-a2a4-02196f9e1c85 req-47a57ac2-907d-4dec-87a0-ddd779bee2ae service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-deleted-63514087-bf1a-4562-bc47-5d4f2ee425e6 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-0e1a947b-2e97-415a-a2a4-02196f9e1c85 req-47a57ac2-907d-4dec-87a0-ddd779bee2ae service nova] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Received event network-vif-deleted-4894df4f-d1e9-4349-9669-0e21ac0d13fd {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:45:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Port f0b59e8a-1964-4699-81f4-6a9c3b08dae0 binding to destination host user is already ACTIVE {{(pid=73476) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 20:45:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:45:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquired lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:45:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:45:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance_info_cache with network_info: [{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Releasing lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG os_brick.utils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[713cf706-f871-45ba-a9e2-5893b5d42e12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f058e7-78d1-47fb-91a7-6054f3d3cbc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:45:59 user nova-compute[73476]: INFO nova.compute.claims [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Claim successful on node user
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[da249356-b566-44a3-9ddb-968c1263585c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b263fd-5b3e-420c-ae56-0171505cf879]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:45:59 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e433e8-90ff-4ccc-94d8-291dded0c520]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG os_brick.utils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:45:59 user nova-compute[73476]: INFO nova.compute.manager [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Took 2.61 seconds to detach 3 volumes for instance.
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.243s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:45:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:45:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:45:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG nova.policy [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '818cdd5f2ecf42739eb1d1d44c2d78e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0bf9d46b5447a495d0cf45071e0c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:46:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Creating image(s)
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "/opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "/opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "50e2a4348cda4e02b968b021d77929bac36bf9ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "50e2a4348cda4e02b968b021d77929bac36bf9ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Successfully created port: 31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.994s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:00 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Deleted allocations for instance 5160d9ff-3e26-4743-8e34-ebae9fd95f8b
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec.part --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG nova.virt.images [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] 90f6bd11-46de-438c-b4ec-77bdac4447f7 was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec.part /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ef0a755c-555c-4a27-a2f6-d12467ddc4f4 tempest-TaggedBootDevicesTest_v242-1367414827 tempest-TaggedBootDevicesTest_v242-1367414827-project-member] Lock "5160d9ff-3e26-4743-8e34-ebae9fd95f8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.993s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec.part /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec.converted" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "50e2a4348cda4e02b968b021d77929bac36bf9ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.163s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec --force-share --output=json" returned: 0 in 0.219s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "50e2a4348cda4e02b968b021d77929bac36bf9ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "50e2a4348cda4e02b968b021d77929bac36bf9ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec,backing_fmt=raw /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec,backing_fmt=raw /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk 1073741824" returned: 0 in 0.248s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "50e2a4348cda4e02b968b021d77929bac36bf9ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.455s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Cannot resize image /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Ensure instance console log exists: /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Successfully updated port: 31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquired lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-2d10cc69-7ca6-4868-b81b-74a1155d9b54 req-b6e68202-9c30-4a60-9f1c-052dca7f7bbc service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-2d10cc69-7ca6-4868-b81b-74a1155d9b54 req-b6e68202-9c30-4a60-9f1c-052dca7f7bbc service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing instance network info cache due to event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2d10cc69-7ca6-4868-b81b-74a1155d9b54 req-b6e68202-9c30-4a60-9f1c-052dca7f7bbc service nova] Acquiring lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:46:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updating instance_info_cache with network_info: [{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Releasing lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Instance network_info: |[{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2d10cc69-7ca6-4868-b81b-74a1155d9b54 req-b6e68202-9c30-4a60-9f1c-052dca7f7bbc service nova] Acquired lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-2d10cc69-7ca6-4868-b81b-74a1155d9b54 req-b6e68202-9c30-4a60-9f1c-052dca7f7bbc service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Start _get_guest_xml network_info=[{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:45:56Z,direct_url=<?>,disk_format='qcow2',id=90f6bd11-46de-438c-b4ec-77bdac4447f7,min_disk=0,min_ram=0,name='tempest-scenario-img--230741483',owner='1c0bf9d46b5447a495d0cf45071e0c27',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:45:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '90f6bd11-46de-438c-b4ec-77bdac4447f7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:46:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:45:56Z,direct_url=<?>,disk_format='qcow2',id=90f6bd11-46de-438c-b4ec-77bdac4447f7,min_disk=0,min_ram=0,name='tempest-scenario-img--230741483',owner='1c0bf9d46b5447a495d0cf45071e0c27',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:45:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-156038062',display_name='tempest-TestMinimumBasicScenario-server-156038062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-156038062',id=15,image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkJCbzXhqk2qkP5QbVoSQJsfJpi0quIEXOrN1Y/M8/7w5E0N6PnAbbhRBVuWJG+5R2Z7GtWVh0b63siP4vpOV4BZpC3h7aMxmwFg7L7UHYfBWP0Fi7o7fm8PbJV8DrNFw==',key_name='tempest-TestMinimumBasicScenario-802005258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c0bf9d46b5447a495d0cf45071e0c27',ramdisk_id='',reservation_id='r-nljd6hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1097465264',owner_user_name='tempest-TestMinimumBasicScenario-1097465264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:46:00Z,user_data=None,user_id='818cdd5f2ecf42739eb1d1d44c2d78e5',uuid=7f2e574f-a47c-45dc-9261-14de64d5ac7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converting VIF {"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.objects.instance [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:46:03 user nova-compute[73476]:   <uuid>7f2e574f-a47c-45dc-9261-14de64d5ac7b</uuid>
Aug 26 20:46:03 user nova-compute[73476]:   <name>instance-0000000f</name>
Aug 26 20:46:03 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:46:03 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:46:03 user nova-compute[73476]:   <metadata>
Aug 26 20:46:03 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:46:03 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:46:03 user nova-compute[73476]:       <nova:name>tempest-TestMinimumBasicScenario-server-156038062</nova:name>
Aug 26 20:46:03 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:46:03</nova:creationTime>
Aug 26 20:46:03 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:46:03 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:46:03 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:46:03 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:46:03 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:46:03 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:46:03 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:46:03 user nova-compute[73476]:       <nova:owner>
Aug 26 20:46:03 user nova-compute[73476]:         <nova:user uuid="818cdd5f2ecf42739eb1d1d44c2d78e5">tempest-TestMinimumBasicScenario-1097465264-project-member</nova:user>
Aug 26 20:46:03 user nova-compute[73476]:         <nova:project uuid="1c0bf9d46b5447a495d0cf45071e0c27">tempest-TestMinimumBasicScenario-1097465264</nova:project>
Aug 26 20:46:03 user nova-compute[73476]:       </nova:owner>
Aug 26 20:46:03 user nova-compute[73476]:       <nova:root type="image" uuid="90f6bd11-46de-438c-b4ec-77bdac4447f7"/>
Aug 26 20:46:03 user nova-compute[73476]:       <nova:ports>
Aug 26 20:46:03 user nova-compute[73476]:         <nova:port uuid="31732c2a-94a0-4be3-b5f5-fbb1488b7161">
Aug 26 20:46:03 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 20:46:03 user nova-compute[73476]:         </nova:port>
Aug 26 20:46:03 user nova-compute[73476]:       </nova:ports>
Aug 26 20:46:03 user nova-compute[73476]:     </nova:instance>
Aug 26 20:46:03 user nova-compute[73476]:   </metadata>
Aug 26 20:46:03 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:46:03 user nova-compute[73476]:     <system>
Aug 26 20:46:03 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:46:03 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:46:03 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:46:03 user nova-compute[73476]:       <entry name="serial">7f2e574f-a47c-45dc-9261-14de64d5ac7b</entry>
Aug 26 20:46:03 user nova-compute[73476]:       <entry name="uuid">7f2e574f-a47c-45dc-9261-14de64d5ac7b</entry>
Aug 26 20:46:03 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:46:03 user nova-compute[73476]:     </system>
Aug 26 20:46:03 user nova-compute[73476]:   </sysinfo>
Aug 26 20:46:03 user nova-compute[73476]:   <os>
Aug 26 20:46:03 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:46:03 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:46:03 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:46:03 user nova-compute[73476]:   </os>
Aug 26 20:46:03 user nova-compute[73476]:   <features>
Aug 26 20:46:03 user nova-compute[73476]:     <acpi/>
Aug 26 20:46:03 user nova-compute[73476]:     <apic/>
Aug 26 20:46:03 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:46:03 user nova-compute[73476]:   </features>
Aug 26 20:46:03 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:46:03 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:46:03 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:46:03 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:46:03 user nova-compute[73476]:   </clock>
Aug 26 20:46:03 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:46:03 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:46:03 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:46:03 user nova-compute[73476]:   </cpu>
Aug 26 20:46:03 user nova-compute[73476]:   <devices>
Aug 26 20:46:03 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:46:03 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:46:03 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk"/>
Aug 26 20:46:03 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:46:03 user nova-compute[73476]:     </disk>
Aug 26 20:46:03 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:46:03 user nova-compute[73476]:       <mac address="fa:16:3e:1b:25:fc"/>
Aug 26 20:46:03 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:03 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:46:03 user nova-compute[73476]:       <target dev="tap31732c2a-94"/>
Aug 26 20:46:03 user nova-compute[73476]:     </interface>
Aug 26 20:46:03 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:46:03 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/console.log" append="off"/>
Aug 26 20:46:03 user nova-compute[73476]:     </serial>
Aug 26 20:46:03 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:46:03 user nova-compute[73476]:     <video>
Aug 26 20:46:03 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:03 user nova-compute[73476]:     </video>
Aug 26 20:46:03 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:46:03 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:46:03 user nova-compute[73476]:     </rng>
Aug 26 20:46:03 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:46:03 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:46:03 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:46:03 user nova-compute[73476]:     </memballoon>
Aug 26 20:46:03 user nova-compute[73476]:   </devices>
Aug 26 20:46:03 user nova-compute[73476]: </domain>
Aug 26 20:46:03 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-156038062',display_name='tempest-TestMinimumBasicScenario-server-156038062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-156038062',id=15,image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkJCbzXhqk2qkP5QbVoSQJsfJpi0quIEXOrN1Y/M8/7w5E0N6PnAbbhRBVuWJG+5R2Z7GtWVh0b63siP4vpOV4BZpC3h7aMxmwFg7L7UHYfBWP0Fi7o7fm8PbJV8DrNFw==',key_name='tempest-TestMinimumBasicScenario-802005258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c0bf9d46b5447a495d0cf45071e0c27',ramdisk_id='',reservation_id='r-nljd6hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1097465264',owner_user_name='tempest-TestMinimumBasicScenario-1097465264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:46:00Z,user_data=None,user_id='818cdd5f2ecf42739eb1d1d44c2d78e5',uuid=7f2e574f-a47c-45dc-9261-14de64d5ac7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converting VIF {"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG os_vif [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31732c2a-94, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31732c2a-94, col_values=(('external_ids', {'iface-id': '31732c2a-94a0-4be3-b5f5-fbb1488b7161', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:25:fc', 'vm-uuid': '7f2e574f-a47c-45dc-9261-14de64d5ac7b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:03 user nova-compute[73476]: INFO os_vif [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94')
Aug 26 20:46:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No VIF found with MAC fa:16:3e:1b:25:fc, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082748.830186, ad42cf47-42fb-488f-a44f-cf9824dd4d99 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:03 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] VM Stopped (Lifecycle Event)
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8bb2f3a1-3ffe-4559-9a17-f2eaa0b16b94 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8bb2f3a1-3ffe-4559-9a17-f2eaa0b16b94 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:03 user nova-compute[73476]: INFO nova.compute.manager [None req-8bb2f3a1-3ffe-4559-9a17-f2eaa0b16b94 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 20:46:04 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082749.2252781, 5160d9ff-3e26-4743-8e34-ebae9fd95f8b => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:04 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] VM Stopped (Lifecycle Event)
Aug 26 20:46:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-68876f8c-9b93-4c17-843d-f620c5a6fe2f None None] [instance: 5160d9ff-3e26-4743-8e34-ebae9fd95f8b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-2d10cc69-7ca6-4868-b81b-74a1155d9b54 req-b6e68202-9c30-4a60-9f1c-052dca7f7bbc service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updated VIF entry in instance network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:46:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-2d10cc69-7ca6-4868-b81b-74a1155d9b54 req-b6e68202-9c30-4a60-9f1c-052dca7f7bbc service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updating instance_info_cache with network_info: [{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2d10cc69-7ca6-4868-b81b-74a1155d9b54 req-b6e68202-9c30-4a60-9f1c-052dca7f7bbc service nova] Releasing lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:05 user nova-compute[73476]: INFO nova.compute.manager [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Terminating instance
Aug 26 20:46:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-8d412c9f-f283-4de7-a0e0-00adab48698f req-999a9367-36e7-4481-97e2-f6a3162be714 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8d412c9f-f283-4de7-a0e0-00adab48698f req-999a9367-36e7-4481-97e2-f6a3162be714 service nova] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8d412c9f-f283-4de7-a0e0-00adab48698f req-999a9367-36e7-4481-97e2-f6a3162be714 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8d412c9f-f283-4de7-a0e0-00adab48698f req-999a9367-36e7-4481-97e2-f6a3162be714 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-8d412c9f-f283-4de7-a0e0-00adab48698f req-999a9367-36e7-4481-97e2-f6a3162be714 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] No waiting events found dispatching network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:05 user nova-compute[73476]: WARNING nova.compute.manager [req-8d412c9f-f283-4de7-a0e0-00adab48698f req-999a9367-36e7-4481-97e2-f6a3162be714 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received unexpected event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 for instance with vm_state building and task_state spawning.
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Instance destroyed successfully.
Aug 26 20:46:06 user nova-compute[73476]: DEBUG nova.objects.instance [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lazy-loading 'resources' on Instance uuid e9309346-2675-4bfd-9781-175b9b40d71e {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1316340121',display_name='tempest-TestVolumeSwap-server-1316340121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1316340121',id=9,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEN3qGYMgIlNUhRrgpbAcY/WhDf6cGpleVK3QszXdXnO3FyKDzkm8b4G9NysMyNkg3QUTjEXpUSCWGhGnosJDw5gDbGiMj3FMllYWd8UCm0pIHUg7y3IGW0HzBVztelBw==',key_name='tempest-keypair-1302543546',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42f12645467c4b44929f8d7006bfdb03',ramdisk_id='',reservation_id='r-rdx6rjjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-11679679',owner_user_name='tempest-TestVolumeSwap-11679679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2cfbf9be26f48aa83e1afc8c120ebe7',uuid=e9309346-2675-4bfd-9781-175b9b40d71e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Converting VIF {"id": "bb78e89a-f134-42de-bf9f-65454e85a33f", "address": "fa:16:3e:00:8e:85", "network": {"id": "5aa93d97-2a1e-4de7-b8b4-e60624c588a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-747213452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f12645467c4b44929f8d7006bfdb03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb78e89a-f1", "ovs_interfaceid": "bb78e89a-f134-42de-bf9f-65454e85a33f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:8e:85,bridge_name='br-int',has_traffic_filtering=True,id=bb78e89a-f134-42de-bf9f-65454e85a33f,network=Network(5aa93d97-2a1e-4de7-b8b4-e60624c588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb78e89a-f1') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG os_vif [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:8e:85,bridge_name='br-int',has_traffic_filtering=True,id=bb78e89a-f134-42de-bf9f-65454e85a33f,network=Network(5aa93d97-2a1e-4de7-b8b4-e60624c588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb78e89a-f1') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb78e89a-f1, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:46:06 user nova-compute[73476]: INFO os_vif [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:8e:85,bridge_name='br-int',has_traffic_filtering=True,id=bb78e89a-f134-42de-bf9f-65454e85a33f,network=Network(5aa93d97-2a1e-4de7-b8b4-e60624c588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb78e89a-f1')
Aug 26 20:46:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Deleting instance files /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e_del
Aug 26 20:46:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Deletion of /opt/stack/data/nova/instances/e9309346-2675-4bfd-9781-175b9b40d71e_del complete
Aug 26 20:46:06 user nova-compute[73476]: INFO nova.compute.manager [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 26 20:46:06 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:46:06 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] No waiting events found dispatching network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:08 user nova-compute[73476]: WARNING nova.compute.manager [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received unexpected event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 for instance with vm_state building and task_state spawning.
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received event network-vif-unplugged-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] No waiting events found dispatching network-vif-unplugged-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received event network-vif-unplugged-bb78e89a-f134-42de-bf9f-65454e85a33f for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received event network-vif-plugged-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] Acquiring lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] Lock "e9309346-2675-4bfd-9781-175b9b40d71e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] No waiting events found dispatching network-vif-plugged-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:08 user nova-compute[73476]: WARNING nova.compute.manager [req-5fab4ec4-930b-48ae-9076-f1ca2101f94b req-7722501e-db71-4afd-bb0c-99d3e876dd03 service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received unexpected event network-vif-plugged-bb78e89a-f134-42de-bf9f-65454e85a33f for instance with vm_state active and task_state deleting.
Aug 26 20:46:08 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Took 1.26 seconds to deallocate network for instance.
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082768.3644397, 7f2e574f-a47c-45dc-9261-14de64d5ac7b => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:08 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] VM Resumed (Lifecycle Event)
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:46:08 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Instance spawned successfully.
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:08 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082768.3685937, 7f2e574f-a47c-45dc-9261-14de64d5ac7b => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:08 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] VM Started (Lifecycle Event)
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:08 user nova-compute[73476]: INFO nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Took 8.34 seconds to spawn the instance on the hypervisor.
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:08 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:46:08 user nova-compute[73476]: INFO nova.compute.manager [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Took 9.45 seconds to build instance.
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0283940d-4e5c-452b-b440-0a46f7ee2bf6 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.561s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:08 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Deleted allocations for instance e9309346-2675-4bfd-9781-175b9b40d71e
Aug 26 20:46:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0a3b5b6b-a04d-45b8-bbba-f4f4e9850fb7 tempest-TestVolumeSwap-11679679 tempest-TestVolumeSwap-11679679-project-member] Lock "e9309346-2675-4bfd-9781-175b9b40d71e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.092s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:46:10 user nova-compute[73476]: INFO nova.compute.claims [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Claim successful on node user
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-afb719df-d209-4e59-a475-9604dbd9a42d req-e552d258-152e-44ab-be49-072b9aa103ff service nova] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Received event network-vif-deleted-bb78e89a-f134-42de-bf9f-65454e85a33f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:46:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.policy [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c8e36ae6a7f4edab7a006e199826ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97d40324fc0432ea4c7ac57cd0fe4b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:46:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Creating image(s)
Aug 26 20:46:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "/opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "/opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "/opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.264s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk 1073741824" returned: 0 in 0.056s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Cannot resize image /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Ensure instance console log exists: /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:12 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Successfully created port: 478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:46:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Starting finish_migration {{(pid=73476) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 20:46:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance directory exists: not creating {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 20:46:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Creating image(s)
Aug 26 20:46:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.267s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:12 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk. size=21474836480 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:46:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Successfully updated port: 478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "refresh_cache-94cfdb65-fd3d-4c46-bc38-f47b55edddd9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquired lock "refresh_cache-94cfdb65-fd3d-4c46-bc38-f47b55edddd9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-91bed97d-bc10-4c83-a3ff-f86deb6386f6 req-7001824b-c010-479a-9184-b49c4fec3dbe service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received event network-changed-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-91bed97d-bc10-4c83-a3ff-f86deb6386f6 req-7001824b-c010-479a-9184-b49c4fec3dbe service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Refreshing instance network info cache due to event network-changed-478d7c28-392c-453d-81f0-e9775f156e9e. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-91bed97d-bc10-4c83-a3ff-f86deb6386f6 req-7001824b-c010-479a-9184-b49c4fec3dbe service nova] Acquiring lock "refresh_cache-94cfdb65-fd3d-4c46-bc38-f47b55edddd9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk 21474836480 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk 21474836480" returned: 0 in 0.053s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Ensure instance console log exists: /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Start _get_guest_xml network_info=[{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-111688451-network", "vif_mac": "fa:16:3e:65:28:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '62cdcca0-3771-4b90-a49b-affff67b156b', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ad42cf47-42fb-488f-a44f-cf9824dd4d99', 'attached_at': '2023-08-26T20:46:12.000000', 'detached_at': '', 'volume_id': '8809a5b6-d0f3-4f59-b94e-220073f5f4c2', 'serial': '8809a5b6-d0f3-4f59-b94e-220073f5f4c2'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:46:13 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:13 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:46:13 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:46:13 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:46:13 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[107152b4-a6f8-4211-9b7d-1272b7bdf455]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:46:13 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4e2807-ee2d-425d-bb83-ead7578f6e1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2] added
Aug 26 20:46:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[be371e2d-b436-4e74-889f-c97cbb9f02e6]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5ed22b-310a-49c7-9bb4-0be35afa8951]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDcINFvz {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDcINFvz" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f130516e-c938-4cff-9564-541826bfba0b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uDcINFvz'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a8cba8-c581-402b-aeab-1a806654634f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cfd15d-57c4-41d8-9b8e-303da36c2a3a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:46:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:46:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62975ac-e694-45eb-a9bb-01555a429c00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]
Aug 26 20:46:13 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.
Aug 26 20:46:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba14cd06-40bc-4ec7-b512-f21a774bf89d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Updating instance_info_cache with network_info: [{"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Releasing lock "refresh_cache-94cfdb65-fd3d-4c46-bc38-f47b55edddd9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Instance network_info: |[{"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f762dd2a-bbb3-4205-8177-f14ee6fed260]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-91bed97d-bc10-4c83-a3ff-f86deb6386f6 req-7001824b-c010-479a-9184-b49c4fec3dbe service nova] Acquired lock "refresh_cache-94cfdb65-fd3d-4c46-bc38-f47b55edddd9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.network.neutron [req-91bed97d-bc10-4c83-a3ff-f86deb6386f6 req-7001824b-c010-479a-9184-b49c4fec3dbe service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Refreshing network info cache for port 478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Start _get_guest_xml network_info=[{"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:46:13 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:46:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:46:13 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:46:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:13 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:13 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-787487812',display_name='tempest-SnapshotDataIntegrityTests-server-787487812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-787487812',id=16,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFfX+CvjJMUoFtV8avxJq1PUGn4eYe0aVt2C6llbafDYn27z4msVfCKm6hj2Wev/M+MI+fsCXG3B7dIYNlXcPSe+oTVFKLmGqxv18Bv6UdvhgZcJm+3pW5uXoFFXNBCAw==',key_name='tempest-keypair-244704665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97d40324fc0432ea4c7ac57cd0fe4b7',ramdisk_id='',reservation_id='r-tzrihpod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2133409530',owner_user_name='tempest-SnapshotDataIntegrityTests-2133409530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8e36ae6a7f4edab7a006e199826ec6',uuid=94cfdb65-fd3d-4c46-bc38-f47b55edddd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Converting VIF {"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:9f,bridge_name='br-int',has_traffic_filtering=True,id=478d7c28-392c-453d-81f0-e9775f156e9e,network=Network(091add1f-3e23-4c25-8e82-cb43df790f4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478d7c28-39') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lazy-loading 'pci_devices' on Instance uuid 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9658ff89-8572-4e79-8c09-f9c0732ed1e9]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:46:13 user nova-compute[73476]:   <uuid>94cfdb65-fd3d-4c46-bc38-f47b55edddd9</uuid>
Aug 26 20:46:13 user nova-compute[73476]:   <name>instance-00000010</name>
Aug 26 20:46:13 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:46:13 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:46:13 user nova-compute[73476]:   <metadata>
Aug 26 20:46:13 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:46:13 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:46:13 user nova-compute[73476]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-787487812</nova:name>
Aug 26 20:46:13 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:46:13</nova:creationTime>
Aug 26 20:46:13 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:46:13 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:46:13 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:46:13 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:46:13 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:46:13 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:46:13 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:46:13 user nova-compute[73476]:       <nova:owner>
Aug 26 20:46:13 user nova-compute[73476]:         <nova:user uuid="0c8e36ae6a7f4edab7a006e199826ec6">tempest-SnapshotDataIntegrityTests-2133409530-project-member</nova:user>
Aug 26 20:46:13 user nova-compute[73476]:         <nova:project uuid="c97d40324fc0432ea4c7ac57cd0fe4b7">tempest-SnapshotDataIntegrityTests-2133409530</nova:project>
Aug 26 20:46:13 user nova-compute[73476]:       </nova:owner>
Aug 26 20:46:13 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:46:13 user nova-compute[73476]:       <nova:ports>
Aug 26 20:46:13 user nova-compute[73476]:         <nova:port uuid="478d7c28-392c-453d-81f0-e9775f156e9e">
Aug 26 20:46:13 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 20:46:13 user nova-compute[73476]:         </nova:port>
Aug 26 20:46:13 user nova-compute[73476]:       </nova:ports>
Aug 26 20:46:13 user nova-compute[73476]:     </nova:instance>
Aug 26 20:46:13 user nova-compute[73476]:   </metadata>
Aug 26 20:46:13 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:46:13 user nova-compute[73476]:     <system>
Aug 26 20:46:13 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:46:13 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:46:13 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:46:13 user nova-compute[73476]:       <entry name="serial">94cfdb65-fd3d-4c46-bc38-f47b55edddd9</entry>
Aug 26 20:46:13 user nova-compute[73476]:       <entry name="uuid">94cfdb65-fd3d-4c46-bc38-f47b55edddd9</entry>
Aug 26 20:46:13 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:46:13 user nova-compute[73476]:     </system>
Aug 26 20:46:13 user nova-compute[73476]:   </sysinfo>
Aug 26 20:46:13 user nova-compute[73476]:   <os>
Aug 26 20:46:13 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:46:13 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:46:13 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:46:13 user nova-compute[73476]:   </os>
Aug 26 20:46:13 user nova-compute[73476]:   <features>
Aug 26 20:46:13 user nova-compute[73476]:     <acpi/>
Aug 26 20:46:13 user nova-compute[73476]:     <apic/>
Aug 26 20:46:13 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:46:13 user nova-compute[73476]:   </features>
Aug 26 20:46:13 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:46:13 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:46:13 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:46:13 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:46:13 user nova-compute[73476]:   </clock>
Aug 26 20:46:13 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:46:13 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:46:13 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:46:13 user nova-compute[73476]:   </cpu>
Aug 26 20:46:13 user nova-compute[73476]:   <devices>
Aug 26 20:46:13 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:46:13 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:46:13 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk"/>
Aug 26 20:46:13 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:46:13 user nova-compute[73476]:     </disk>
Aug 26 20:46:13 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:46:13 user nova-compute[73476]:       <mac address="fa:16:3e:b2:74:9f"/>
Aug 26 20:46:13 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:13 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:46:13 user nova-compute[73476]:       <target dev="tap478d7c28-39"/>
Aug 26 20:46:13 user nova-compute[73476]:     </interface>
Aug 26 20:46:13 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:46:13 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/console.log" append="off"/>
Aug 26 20:46:13 user nova-compute[73476]:     </serial>
Aug 26 20:46:13 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:46:13 user nova-compute[73476]:     <video>
Aug 26 20:46:13 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:13 user nova-compute[73476]:     </video>
Aug 26 20:46:13 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:46:13 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:46:13 user nova-compute[73476]:     </rng>
Aug 26 20:46:13 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:46:13 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:46:13 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:46:13 user nova-compute[73476]:     </memballoon>
Aug 26 20:46:13 user nova-compute[73476]:   </devices>
Aug 26 20:46:13 user nova-compute[73476]: </domain>
Aug 26 20:46:13 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-787487812',display_name='tempest-SnapshotDataIntegrityTests-server-787487812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-787487812',id=16,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFfX+CvjJMUoFtV8avxJq1PUGn4eYe0aVt2C6llbafDYn27z4msVfCKm6hj2Wev/M+MI+fsCXG3B7dIYNlXcPSe+oTVFKLmGqxv18Bv6UdvhgZcJm+3pW5uXoFFXNBCAw==',key_name='tempest-keypair-244704665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97d40324fc0432ea4c7ac57cd0fe4b7',ramdisk_id='',reservation_id='r-tzrihpod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2133409530',owner_user_name='tempest-SnapshotDataIntegrityTests-2133409530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8e36ae6a7f4edab7a006e199826ec6',uuid=94cfdb65-fd3d-4c46-bc38-f47b55edddd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Converting VIF {"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:9f,bridge_name='br-int',has_traffic_filtering=True,id=478d7c28-392c-453d-81f0-e9775f156e9e,network=Network(091add1f-3e23-4c25-8e82-cb43df790f4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478d7c28-39') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG os_vif [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:9f,bridge_name='br-int',has_traffic_filtering=True,id=478d7c28-392c-453d-81f0-e9775f156e9e,network=Network(091add1f-3e23-4c25-8e82-cb43df790f4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478d7c28-39') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap478d7c28-39, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap478d7c28-39, col_values=(('external_ids', {'iface-id': '478d7c28-392c-453d-81f0-e9775f156e9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:74:9f', 'vm-uuid': '94cfdb65-fd3d-4c46-bc38-f47b55edddd9'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:13 user nova-compute[73476]: INFO os_vif [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:9f,bridge_name='br-int',has_traffic_filtering=True,id=478d7c28-392c-453d-81f0-e9775f156e9e,network=Network(091add1f-3e23-4c25-8e82-cb43df790f4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478d7c28-39')
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:46:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] No VIF found with MAC fa:16:3e:b2:74:9f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.network.neutron [req-91bed97d-bc10-4c83-a3ff-f86deb6386f6 req-7001824b-c010-479a-9184-b49c4fec3dbe service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Updated VIF entry in instance network info cache for port 478d7c28-392c-453d-81f0-e9775f156e9e. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.network.neutron [req-91bed97d-bc10-4c83-a3ff-f86deb6386f6 req-7001824b-c010-479a-9184-b49c4fec3dbe service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Updating instance_info_cache with network_info: [{"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-91bed97d-bc10-4c83-a3ff-f86deb6386f6 req-7001824b-c010-479a-9184-b49c4fec3dbe service nova] Releasing lock "refresh_cache-94cfdb65-fd3d-4c46-bc38-f47b55edddd9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23838373138666163', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838373138666163', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-263678955',display_name='tempest-ServerActionsTestOtherB-server-263678955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-263678955',id=5,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6duovOgpoS/+TE0EH/fCNy+ilV5kxrulfvMaTJVTAkoOJVt3B0olv0pH7NT01fhQF+CMU3wUX3bGKgX/wKj8M/GNeOdqt2EwZ91VfdEmDAANieG8njlOp1SAEmAi7Ug==',key_name='tempest-keypair-1212818177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76a9f74cd94849f7a132c168b1ed5622',ramdisk_id='',reservation_id='r-ns6go6pz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-42689020',owner_user_name='tempest-ServerActionsTestOtherB-42689020-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18713e0a843f45f08cdb8d70e7cafeeb',uuid=ad42cf47-42fb-488f-a44f-cf9824dd4d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-111688451-network", "vif_mac": "fa:16:3e:65:28:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converting VIF {"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-111688451-network", "vif_mac": "fa:16:3e:65:28:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:46:14 user nova-compute[73476]:   <uuid>ad42cf47-42fb-488f-a44f-cf9824dd4d99</uuid>
Aug 26 20:46:14 user nova-compute[73476]:   <name>instance-00000005</name>
Aug 26 20:46:14 user nova-compute[73476]:   <memory>2097152</memory>
Aug 26 20:46:14 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:46:14 user nova-compute[73476]:   <metadata>
Aug 26 20:46:14 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:46:14 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:46:14 user nova-compute[73476]:       <nova:name>tempest-ServerActionsTestOtherB-server-263678955</nova:name>
Aug 26 20:46:14 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:46:13</nova:creationTime>
Aug 26 20:46:14 user nova-compute[73476]:       <nova:flavor name="m1.small">
Aug 26 20:46:14 user nova-compute[73476]:         <nova:memory>2048</nova:memory>
Aug 26 20:46:14 user nova-compute[73476]:         <nova:disk>20</nova:disk>
Aug 26 20:46:14 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:46:14 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:46:14 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:46:14 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:46:14 user nova-compute[73476]:       <nova:owner>
Aug 26 20:46:14 user nova-compute[73476]:         <nova:user uuid="18713e0a843f45f08cdb8d70e7cafeeb">tempest-ServerActionsTestOtherB-42689020-project-member</nova:user>
Aug 26 20:46:14 user nova-compute[73476]:         <nova:project uuid="76a9f74cd94849f7a132c168b1ed5622">tempest-ServerActionsTestOtherB-42689020</nova:project>
Aug 26 20:46:14 user nova-compute[73476]:       </nova:owner>
Aug 26 20:46:14 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:46:14 user nova-compute[73476]:       <nova:ports>
Aug 26 20:46:14 user nova-compute[73476]:         <nova:port uuid="f0b59e8a-1964-4699-81f4-6a9c3b08dae0">
Aug 26 20:46:14 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 20:46:14 user nova-compute[73476]:         </nova:port>
Aug 26 20:46:14 user nova-compute[73476]:       </nova:ports>
Aug 26 20:46:14 user nova-compute[73476]:     </nova:instance>
Aug 26 20:46:14 user nova-compute[73476]:   </metadata>
Aug 26 20:46:14 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:46:14 user nova-compute[73476]:     <system>
Aug 26 20:46:14 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:46:14 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:46:14 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:46:14 user nova-compute[73476]:       <entry name="serial">ad42cf47-42fb-488f-a44f-cf9824dd4d99</entry>
Aug 26 20:46:14 user nova-compute[73476]:       <entry name="uuid">ad42cf47-42fb-488f-a44f-cf9824dd4d99</entry>
Aug 26 20:46:14 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:46:14 user nova-compute[73476]:     </system>
Aug 26 20:46:14 user nova-compute[73476]:   </sysinfo>
Aug 26 20:46:14 user nova-compute[73476]:   <os>
Aug 26 20:46:14 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:46:14 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:46:14 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:46:14 user nova-compute[73476]:   </os>
Aug 26 20:46:14 user nova-compute[73476]:   <features>
Aug 26 20:46:14 user nova-compute[73476]:     <acpi/>
Aug 26 20:46:14 user nova-compute[73476]:     <apic/>
Aug 26 20:46:14 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:46:14 user nova-compute[73476]:   </features>
Aug 26 20:46:14 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:46:14 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:46:14 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:46:14 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:46:14 user nova-compute[73476]:   </clock>
Aug 26 20:46:14 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:46:14 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:46:14 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:46:14 user nova-compute[73476]:   </cpu>
Aug 26 20:46:14 user nova-compute[73476]:   <devices>
Aug 26 20:46:14 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:46:14 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:46:14 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk"/>
Aug 26 20:46:14 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:46:14 user nova-compute[73476]:     </disk>
Aug 26 20:46:14 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:46:14 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:46:14 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 20:46:14 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:46:14 user nova-compute[73476]:       <serial>8809a5b6-d0f3-4f59-b94e-220073f5f4c2</serial>
Aug 26 20:46:14 user nova-compute[73476]:     </disk>
Aug 26 20:46:14 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:46:14 user nova-compute[73476]:       <mac address="fa:16:3e:65:28:58"/>
Aug 26 20:46:14 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:14 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:46:14 user nova-compute[73476]:       <target dev="tapf0b59e8a-19"/>
Aug 26 20:46:14 user nova-compute[73476]:     </interface>
Aug 26 20:46:14 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:46:14 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/console.log" append="off"/>
Aug 26 20:46:14 user nova-compute[73476]:     </serial>
Aug 26 20:46:14 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:46:14 user nova-compute[73476]:     <video>
Aug 26 20:46:14 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:14 user nova-compute[73476]:     </video>
Aug 26 20:46:14 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:46:14 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:46:14 user nova-compute[73476]:     </rng>
Aug 26 20:46:14 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:46:14 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:46:14 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:46:14 user nova-compute[73476]:     </memballoon>
Aug 26 20:46:14 user nova-compute[73476]:   </devices>
Aug 26 20:46:14 user nova-compute[73476]: </domain>
Aug 26 20:46:14 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-263678955',display_name='tempest-ServerActionsTestOtherB-server-263678955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-263678955',id=5,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6duovOgpoS/+TE0EH/fCNy+ilV5kxrulfvMaTJVTAkoOJVt3B0olv0pH7NT01fhQF+CMU3wUX3bGKgX/wKj8M/GNeOdqt2EwZ91VfdEmDAANieG8njlOp1SAEmAi7Ug==',key_name='tempest-keypair-1212818177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76a9f74cd94849f7a132c168b1ed5622',ramdisk_id='',reservation_id='r-ns6go6pz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-42689020',owner_user_name='tempest-ServerActionsTestOtherB-42689020-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18713e0a843f45f08cdb8d70e7cafeeb',uuid=ad42cf47-42fb-488f-a44f-cf9824dd4d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-111688451-network", "vif_mac": "fa:16:3e:65:28:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converting VIF {"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-111688451-network", "vif_mac": "fa:16:3e:65:28:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG os_vif [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0b59e8a-19, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0b59e8a-19, col_values=(('external_ids', {'iface-id': 'f0b59e8a-1964-4699-81f4-6a9c3b08dae0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:28:58', 'vm-uuid': 'ad42cf47-42fb-488f-a44f-cf9824dd4d99'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:14 user nova-compute[73476]: INFO os_vif [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19')
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:46:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] No VIF found with MAC fa:16:3e:65:28:58, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-fcaa0f87-dd15-4ffc-b77d-7f92b38e865d req-40b6fdea-ad3b-4a08-896f-5acb6937b5da service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received event network-vif-plugged-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fcaa0f87-dd15-4ffc-b77d-7f92b38e865d req-40b6fdea-ad3b-4a08-896f-5acb6937b5da service nova] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fcaa0f87-dd15-4ffc-b77d-7f92b38e865d req-40b6fdea-ad3b-4a08-896f-5acb6937b5da service nova] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fcaa0f87-dd15-4ffc-b77d-7f92b38e865d req-40b6fdea-ad3b-4a08-896f-5acb6937b5da service nova] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-fcaa0f87-dd15-4ffc-b77d-7f92b38e865d req-40b6fdea-ad3b-4a08-896f-5acb6937b5da service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] No waiting events found dispatching network-vif-plugged-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:15 user nova-compute[73476]: WARNING nova.compute.manager [req-fcaa0f87-dd15-4ffc-b77d-7f92b38e865d req-40b6fdea-ad3b-4a08-896f-5acb6937b5da service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received unexpected event network-vif-plugged-478d7c28-392c-453d-81f0-e9775f156e9e for instance with vm_state building and task_state spawning.
Aug 26 20:46:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:16 user nova-compute[73476]: INFO nova.compute.manager [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Rescuing
Aug 26 20:46:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:46:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquired lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:46:16 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:46:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received event network-vif-plugged-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] No waiting events found dispatching network-vif-plugged-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:17 user nova-compute[73476]: WARNING nova.compute.manager [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received unexpected event network-vif-plugged-478d7c28-392c-453d-81f0-e9775f156e9e for instance with vm_state building and task_state spawning.
Aug 26 20:46:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:17 user nova-compute[73476]: WARNING nova.compute.manager [req-05aa7854-66cb-41fd-8d72-90db8cbdc468 req-c1bc3c96-c3c9-479d-9a5b-2a38b6f77879 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state active and task_state resize_finish.
Aug 26 20:46:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updating instance_info_cache with network_info: [{"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Releasing lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG nova.compute.manager [req-5f1f9c53-cc1f-46bf-b5a5-f5777598724d req-6552d462-693e-4c19-bf77-4f773fd9c7dc service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5f1f9c53-cc1f-46bf-b5a5-f5777598724d req-6552d462-693e-4c19-bf77-4f773fd9c7dc service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5f1f9c53-cc1f-46bf-b5a5-f5777598724d req-6552d462-693e-4c19-bf77-4f773fd9c7dc service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5f1f9c53-cc1f-46bf-b5a5-f5777598724d req-6552d462-693e-4c19-bf77-4f773fd9c7dc service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG nova.compute.manager [req-5f1f9c53-cc1f-46bf-b5a5-f5777598724d req-6552d462-693e-4c19-bf77-4f773fd9c7dc service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:18 user nova-compute[73476]: WARNING nova.compute.manager [req-5f1f9c53-cc1f-46bf-b5a5-f5777598724d req-6552d462-693e-4c19-bf77-4f773fd9c7dc service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state active and task_state rescuing.
Aug 26 20:46:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Instance destroyed successfully.
Aug 26 20:46:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Attempting a stable device rescue
Aug 26 20:46:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73476) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Instance directory exists: not creating {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 20:46:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Creating image(s)
Aug 26 20:46:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "/opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "/opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'trusted_certs' on Instance uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082778.9721763, 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:18 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] VM Resumed (Lifecycle Event)
Aug 26 20:46:18 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:46:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Instance spawned successfully.
Aug 26 20:46:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "43890b37b382a9176bcfb9ef243693abc96965c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "43890b37b382a9176bcfb9ef243693abc96965c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:19 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082778.974387, 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:19 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] VM Started (Lifecycle Event)
Aug 26 20:46:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:20 user nova-compute[73476]: INFO nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Took 9.33 seconds to spawn the instance on the hypervisor.
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-ad4989c7-96f7-4757-b2e9-24e4ae436558 req-a18cf361-59db-4a70-a7a6-b4891488e91d service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ad4989c7-96f7-4757-b2e9-24e4ae436558 req-a18cf361-59db-4a70-a7a6-b4891488e91d service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ad4989c7-96f7-4757-b2e9-24e4ae436558 req-a18cf361-59db-4a70-a7a6-b4891488e91d service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ad4989c7-96f7-4757-b2e9-24e4ae436558 req-a18cf361-59db-4a70-a7a6-b4891488e91d service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-ad4989c7-96f7-4757-b2e9-24e4ae436558 req-a18cf361-59db-4a70-a7a6-b4891488e91d service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:20 user nova-compute[73476]: WARNING nova.compute.manager [req-ad4989c7-96f7-4757-b2e9-24e4ae436558 req-a18cf361-59db-4a70-a7a6-b4891488e91d service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state active and task_state resize_finish.
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:20 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082779.3963568, ad42cf47-42fb-488f-a44f-cf9824dd4d99 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:20 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] VM Resumed (Lifecycle Event)
Aug 26 20:46:20 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance running successfully.
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Failed to set time: agent not configured {{(pid=73476) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a6d7698f-66d0-441b-a837-a3f24936584d tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] finish_migration finished successfully. {{(pid=73476) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7.part --force-share --output=json" returned: 0 in 0.319s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.virt.images [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] caf7c64f-a578-4e85-aa77-1d83e60e3598 was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7.part /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:20 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082779.3965704, ad42cf47-42fb-488f-a44f-cf9824dd4d99 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:20 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] VM Started (Lifecycle Event)
Aug 26 20:46:20 user nova-compute[73476]: INFO nova.compute.manager [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Took 10.39 seconds to build instance.
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d5f361ac-bc39-4804-88cb-1b30dab6a451 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.565s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:20 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-addcebea-603e-462c-8a82-22ce722d7d56 req-2ff14b1d-3dce-47ef-b850-61225cfcdffc service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-addcebea-603e-462c-8a82-22ce722d7d56 req-2ff14b1d-3dce-47ef-b850-61225cfcdffc service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-addcebea-603e-462c-8a82-22ce722d7d56 req-2ff14b1d-3dce-47ef-b850-61225cfcdffc service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-addcebea-603e-462c-8a82-22ce722d7d56 req-2ff14b1d-3dce-47ef-b850-61225cfcdffc service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-addcebea-603e-462c-8a82-22ce722d7d56 req-2ff14b1d-3dce-47ef-b850-61225cfcdffc service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:20 user nova-compute[73476]: WARNING nova.compute.manager [req-addcebea-603e-462c-8a82-22ce722d7d56 req-2ff14b1d-3dce-47ef-b850-61225cfcdffc service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state active and task_state rescuing.
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7.part /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7.converted" returned: 0 in 0.320s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7.converted --force-share --output=json" returned: 0 in 0.287s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "43890b37b382a9176bcfb9ef243693abc96965c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.999s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "43890b37b382a9176bcfb9ef243693abc96965c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "43890b37b382a9176bcfb9ef243693abc96965c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7 --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7,backing_fmt=raw /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7,backing_fmt=raw /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue" returned: 0 in 0.053s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "43890b37b382a9176bcfb9ef243693abc96965c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'migration_context' on Instance uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<c2b05cbc-2666-4c5c-9a5b-be01236a1229> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Start _get_guest_xml network_info=[{"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "vif_mac": "fa:16:3e:47:43:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'caf7c64f-a578-4e85-aa77-1d83e60e3598', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '90d03a89-a09e-4f58-b8d6-58375ecd8142', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCIXAPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'c2b05cbc-2666-4c5c-9a5b-be01236a1229', 'attached_at': '', 'detached_at': '', 'volume_id': '9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa', 'serial': '9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'resources' on Instance uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<c2b05cbc-2666-4c5c-9a5b-be01236a1229> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'numa_topology' on Instance uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<c2b05cbc-2666-4c5c-9a5b-be01236a1229> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:21 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:21 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'vcpu_model' on Instance uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<c2b05cbc-2666-4c5c-9a5b-be01236a1229> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCIXAPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:46:21 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:46:21 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:46:21 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[513f2f79-f600-42b8-9ab0-02742664c00e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HCIXAPYO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 20:46:21 user nova-compute[73476]: node.name = iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa
Aug 26 20:46:21 user nova-compute[73476]: node.tpgt = -1
Aug 26 20:46:21 user nova-compute[73476]: node.startup = automatic
Aug 26 20:46:21 user nova-compute[73476]: node.leading_login = No
Aug 26 20:46:21 user nova-compute[73476]: iface.iscsi_ifacename = default
Aug 26 20:46:21 user nova-compute[73476]: iface.net_ifacename = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.ipaddress = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.prefix_len = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.hwaddress = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.transport_name = tcp
Aug 26 20:46:21 user nova-compute[73476]: iface.initiatorname = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.state = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.vlan_id = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.vlan_priority = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.vlan_state = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.iface_num = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.mtu = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.port = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.bootproto = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.subnet_mask = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.gateway = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.dhcp_alt_client_id = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.dhcp_dns = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.dhcp_learn_iqn = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.dhcp_vendor_id_state = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.dhcp_vendor_id = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.dhcp_slp_da = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.fragmentation = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.gratuitous_arp = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.incoming_forwarding = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.tos_state = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.tos = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.ttl = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.delayed_ack = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.tcp_nagle = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.tcp_wsf_state = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.tcp_wsf = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.tcp_timer_scale = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.tcp_timestamp = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.redirect = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.def_task_mgmt_timeout = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.header_digest = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.data_digest = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.immediate_data = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.initial_r2t = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.data_seq_inorder = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.data_pdu_inorder = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.erl = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.max_receive_data_len = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.first_burst_len = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.max_outstanding_r2t = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.max_burst_len = 0
Aug 26 20:46:21 user nova-compute[73476]: iface.chap_auth = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.bidi_chap = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.strict_login_compliance = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.discovery_auth = <empty>
Aug 26 20:46:21 user nova-compute[73476]: iface.discovery_logout = <empty>
Aug 26 20:46:21 user nova-compute[73476]: node.discovery_address = <empty>
Aug 26 20:46:21 user nova-compute[73476]: node.discovery_port = 0
Aug 26 20:46:21 user nova-compute[73476]: node.discovery_type = static
Aug 26 20:46:21 user nova-compute[73476]: node.session.initial_cmdsn = 0
Aug 26 20:46:21 user nova-compute[73476]: node.session.initial_login_retry_max = 8
Aug 26 20:46:21 user nova-compute[73476]: node.session.xmit_thread_priority = -20
Aug 26 20:46:21 user nova-compute[73476]: node.session.cmds_max = 128
Aug 26 20:46:21 user nova-compute[73476]: node.session.queue_depth = 32
Aug 26 20:46:21 user nova-compute[73476]: node.session.nr_sessions = 1
Aug 26 20:46:21 user nova-compute[73476]: node.session.auth.authmethod = CHAP
Aug 26 20:46:21 user nova-compute[73476]: node.session.auth.username = HCIXAPYO
Aug 26 20:46:21 user nova-compute[73476]: node.session.auth.password = ***
Aug 26 20:46:21 user nova-compute[73476]: node.session.auth.username_in = <empty>
Aug 26 20:46:21 user nova-compute[73476]: node.session.auth.password_in = <empty>
Aug 26 20:46:21 user nova-compute[73476]: node.session.auth.chap_algs = MD5
Aug 26 20:46:21 user nova-compute[73476]: node.session.timeo.replacement_timeout = 120
Aug 26 20:46:21 user nova-compute[73476]: node.session.err_timeo.abort_timeout = 15
Aug 26 20:46:21 user nova-compute[73476]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 20:46:21 user nova-compute[73476]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 20:46:21 user nova-compute[73476]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.FastAbort = Yes
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.InitialR2T = No
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.ImmediateData = Yes
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.MaxConnections = 1
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 20:46:21 user nova-compute[73476]: node.session.iscsi.ERL = 0
Aug 26 20:46:21 user nova-compute[73476]: node.session.scan = manual
Aug 26 20:46:21 user nova-compute[73476]: node.session.reopen_max = 0
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].address = 172.16.0.220
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].port = 3260
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].startup = manual
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].tcp.window_size = 524288
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].tcp.type_of_service = 0
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].timeo.logout_timeout = 15
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].timeo.login_timeout = 15
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].timeo.auth_timeout = 45
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].iscsi.DataDigest = None
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].iscsi.IFMarker = No
Aug 26 20:46:21 user nova-compute[73476]: node.conn[0].iscsi.OFMarker = No
Aug 26 20:46:21 user nova-compute[73476]: # END RECORD
Aug 26 20:46:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[52655723-82e6-4b80-b815-33a4c6f8e7b5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[106935dc-8b85-4d7a-8808-2746b3abd72b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCIXAPYO {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCIXAPYO" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99b301e-86e8-41bd-8fe5-9602b202a333]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HCIXAPYO'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f357e3-ee8c-46d0-887c-3d2772128c05]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c08b15d-c83d-4b59-82fc-13696ea9e179]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:46:21 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:46:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:46:21 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:46:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] HCTL ('39', '0', '0', 0) found on session 13 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8174ccf-5a02-48e7-81e8-28ed90e030e5]: (4, ('0 0 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching for a device in session 13 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCIXAPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] <== connect_volume: return (193ms) {'type': 'block', 'scsi_wwn': '23963373264326564', 'path': '/dev/sdh'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963373264326564', 'path': '/dev/sdh'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082766.6717048, e9309346-2675-4bfd-9781-175b9b40d71e => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:21 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] VM Stopped (Lifecycle Event)
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3584aeca-cff5-414a-b7db-738b7a4b6259 None None] [instance: e9309346-2675-4bfd-9781-175b9b40d71e] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-495477562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-495477562',id=12,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-w4u5mw1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:44:52Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=c2b05cbc-2666-4c5c-9a5b-be01236a1229,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "vif_mac": "fa:16:3e:47:43:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "vif_mac": "fa:16:3e:47:43:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:43:db,bridge_name='br-int',has_traffic_filtering=True,id=b51ff675-dbca-4a11-8ed4-a7040a20f850,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51ff675-db') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'pci_devices' on Instance uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.objects.base [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<c2b05cbc-2666-4c5c-9a5b-be01236a1229> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:46:21 user nova-compute[73476]:   <uuid>c2b05cbc-2666-4c5c-9a5b-be01236a1229</uuid>
Aug 26 20:46:21 user nova-compute[73476]:   <name>instance-0000000c</name>
Aug 26 20:46:21 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:46:21 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:46:21 user nova-compute[73476]:   <metadata>
Aug 26 20:46:21 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:46:21 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:46:21 user nova-compute[73476]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-495477562</nova:name>
Aug 26 20:46:21 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:46:21</nova:creationTime>
Aug 26 20:46:21 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:46:21 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:46:21 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:46:21 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:46:21 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:46:21 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:46:21 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:46:21 user nova-compute[73476]:       <nova:owner>
Aug 26 20:46:21 user nova-compute[73476]:         <nova:user uuid="5ed2a98f37294fd381fd1dfe7c5c0751">tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member</nova:user>
Aug 26 20:46:21 user nova-compute[73476]:         <nova:project uuid="679727d63ba04ad48740d1b967be5a61">tempest-ServerBootFromVolumeStableRescueTest-735166680</nova:project>
Aug 26 20:46:21 user nova-compute[73476]:       </nova:owner>
Aug 26 20:46:21 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:46:21 user nova-compute[73476]:       <nova:ports>
Aug 26 20:46:21 user nova-compute[73476]:         <nova:port uuid="b51ff675-dbca-4a11-8ed4-a7040a20f850">
Aug 26 20:46:21 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 20:46:21 user nova-compute[73476]:         </nova:port>
Aug 26 20:46:21 user nova-compute[73476]:       </nova:ports>
Aug 26 20:46:21 user nova-compute[73476]:     </nova:instance>
Aug 26 20:46:21 user nova-compute[73476]:   </metadata>
Aug 26 20:46:21 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:46:21 user nova-compute[73476]:     <system>
Aug 26 20:46:21 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:46:21 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:46:21 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:46:21 user nova-compute[73476]:       <entry name="serial">c2b05cbc-2666-4c5c-9a5b-be01236a1229</entry>
Aug 26 20:46:21 user nova-compute[73476]:       <entry name="uuid">c2b05cbc-2666-4c5c-9a5b-be01236a1229</entry>
Aug 26 20:46:21 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:46:21 user nova-compute[73476]:     </system>
Aug 26 20:46:21 user nova-compute[73476]:   </sysinfo>
Aug 26 20:46:21 user nova-compute[73476]:   <os>
Aug 26 20:46:21 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:46:21 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:46:21 user nova-compute[73476]:   </os>
Aug 26 20:46:21 user nova-compute[73476]:   <features>
Aug 26 20:46:21 user nova-compute[73476]:     <acpi/>
Aug 26 20:46:21 user nova-compute[73476]:     <apic/>
Aug 26 20:46:21 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:46:21 user nova-compute[73476]:   </features>
Aug 26 20:46:21 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:46:21 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:46:21 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:46:21 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:46:21 user nova-compute[73476]:   </clock>
Aug 26 20:46:21 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:46:21 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:46:21 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:46:21 user nova-compute[73476]:   </cpu>
Aug 26 20:46:21 user nova-compute[73476]:   <devices>
Aug 26 20:46:21 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:46:21 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:46:21 user nova-compute[73476]:       <source dev="/dev/sdh"/>
Aug 26 20:46:21 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:46:21 user nova-compute[73476]:       <serial>9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa</serial>
Aug 26 20:46:21 user nova-compute[73476]:     </disk>
Aug 26 20:46:21 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:46:21 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:46:21 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue"/>
Aug 26 20:46:21 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:46:21 user nova-compute[73476]:       <boot order="1"/>
Aug 26 20:46:21 user nova-compute[73476]:     </disk>
Aug 26 20:46:21 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:46:21 user nova-compute[73476]:       <mac address="fa:16:3e:47:43:db"/>
Aug 26 20:46:21 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:21 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:46:21 user nova-compute[73476]:       <target dev="tapb51ff675-db"/>
Aug 26 20:46:21 user nova-compute[73476]:     </interface>
Aug 26 20:46:21 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:46:21 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/console.log" append="off"/>
Aug 26 20:46:21 user nova-compute[73476]:     </serial>
Aug 26 20:46:21 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:46:21 user nova-compute[73476]:     <video>
Aug 26 20:46:21 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:21 user nova-compute[73476]:     </video>
Aug 26 20:46:21 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:46:21 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:46:21 user nova-compute[73476]:     </rng>
Aug 26 20:46:21 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:46:21 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:46:21 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:46:21 user nova-compute[73476]:     </memballoon>
Aug 26 20:46:21 user nova-compute[73476]:   </devices>
Aug 26 20:46:21 user nova-compute[73476]: </domain>
Aug 26 20:46:21 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:46:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Instance destroyed successfully.
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:46:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No VIF found with MAC fa:16:3e:47:43:db, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-cfed6669-5354-4670-b82e-0de3808d2ee8 req-01b6f34e-f104-4f93-a612-663cbd606e9f service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cfed6669-5354-4670-b82e-0de3808d2ee8 req-01b6f34e-f104-4f93-a612-663cbd606e9f service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cfed6669-5354-4670-b82e-0de3808d2ee8 req-01b6f34e-f104-4f93-a612-663cbd606e9f service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cfed6669-5354-4670-b82e-0de3808d2ee8 req-01b6f34e-f104-4f93-a612-663cbd606e9f service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-cfed6669-5354-4670-b82e-0de3808d2ee8 req-01b6f34e-f104-4f93-a612-663cbd606e9f service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:23 user nova-compute[73476]: WARNING nova.compute.manager [req-cfed6669-5354-4670-b82e-0de3808d2ee8 req-01b6f34e-f104-4f93-a612-663cbd606e9f service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state active and task_state rescuing.
Aug 26 20:46:23 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:23 user nova-compute[73476]: INFO nova.compute.manager [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Rescuing
Aug 26 20:46:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquired lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:46:23 user nova-compute[73476]: DEBUG nova.network.neutron [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:46:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:24 user nova-compute[73476]: DEBUG nova.network.neutron [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updating instance_info_cache with network_info: [{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Releasing lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:46:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-8a49e867-4ade-42e4-ae7c-20a51215af42 req-5039c609-90fc-4a06-abf0-548a771c4466 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8a49e867-4ade-42e4-ae7c-20a51215af42 req-5039c609-90fc-4a06-abf0-548a771c4466 service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8a49e867-4ade-42e4-ae7c-20a51215af42 req-5039c609-90fc-4a06-abf0-548a771c4466 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8a49e867-4ade-42e4-ae7c-20a51215af42 req-5039c609-90fc-4a06-abf0-548a771c4466 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-8a49e867-4ade-42e4-ae7c-20a51215af42 req-5039c609-90fc-4a06-abf0-548a771c4466 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:25 user nova-compute[73476]: WARNING nova.compute.manager [req-8a49e867-4ade-42e4-ae7c-20a51215af42 req-5039c609-90fc-4a06-abf0-548a771c4466 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state rescuing.
Aug 26 20:46:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:46:25 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Instance destroyed successfully.
Aug 26 20:46:25 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Attempting rescue
Aug 26 20:46:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73476) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Instance directory exists: not creating {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 20:46:25 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Creating image(s)
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'trusted_certs' on Instance uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-fe30259b-cfd5-4927-aa3c-6342c9d82cc8 req-8ddc4acb-7174-4d3f-9ce8-93f62fb8edf5 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fe30259b-cfd5-4927-aa3c-6342c9d82cc8 req-8ddc4acb-7174-4d3f-9ce8-93f62fb8edf5 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fe30259b-cfd5-4927-aa3c-6342c9d82cc8 req-8ddc4acb-7174-4d3f-9ce8-93f62fb8edf5 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fe30259b-cfd5-4927-aa3c-6342c9d82cc8 req-8ddc4acb-7174-4d3f-9ce8-93f62fb8edf5 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-fe30259b-cfd5-4927-aa3c-6342c9d82cc8 req-8ddc4acb-7174-4d3f-9ce8-93f62fb8edf5 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:25 user nova-compute[73476]: WARNING nova.compute.manager [req-fe30259b-cfd5-4927-aa3c-6342c9d82cc8 req-8ddc4acb-7174-4d3f-9ce8-93f62fb8edf5 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state active and task_state rescuing.
Aug 26 20:46:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.265s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue" returned: 0 in 0.070s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'migration_context' on Instance uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for c2b05cbc-2666-4c5c-9a5b-be01236a1229 due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082786.1062827, c2b05cbc-2666-4c5c-9a5b-be01236a1229 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:26 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] VM Resumed (Lifecycle Event)
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e2a2ed90-fa7c-4a44-b15d-c921b2d16860 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.base [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<531953d6-502b-4f11-8a53-0bf267bec1f0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Start _get_guest_xml network_info=[{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "vif_mac": "fa:16:3e:00:c3:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'resources' on Instance uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.base [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<531953d6-502b-4f11-8a53-0bf267bec1f0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'numa_topology' on Instance uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.base [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<531953d6-502b-4f11-8a53-0bf267bec1f0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:26 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:26 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'vcpu_model' on Instance uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:26 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082786.108921, c2b05cbc-2666-4c5c-9a5b-be01236a1229 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:26 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] VM Started (Lifecycle Event)
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.base [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<531953d6-502b-4f11-8a53-0bf267bec1f0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1167118621',display_name='tempest-ServerRescueNegativeTestJSON-server-1167118621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1167118621',id=3,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:41:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-j4eiyvfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:41:58Z,user_data=None,user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=531953d6-502b-4f11-8a53-0bf267bec1f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "vif_mac": "fa:16:3e:00:c3:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "vif_mac": "fa:16:3e:00:c3:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:c3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f21f3f69-c470-4a8e-9166-7b8a4dee07fb,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21f3f69-c4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'pci_devices' on Instance uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.objects.base [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<531953d6-502b-4f11-8a53-0bf267bec1f0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:46:26 user nova-compute[73476]:   <uuid>531953d6-502b-4f11-8a53-0bf267bec1f0</uuid>
Aug 26 20:46:26 user nova-compute[73476]:   <name>instance-00000003</name>
Aug 26 20:46:26 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:46:26 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:46:26 user nova-compute[73476]:   <metadata>
Aug 26 20:46:26 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:46:26 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:46:26 user nova-compute[73476]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1167118621</nova:name>
Aug 26 20:46:26 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:46:26</nova:creationTime>
Aug 26 20:46:26 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:46:26 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:46:26 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:46:26 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:46:26 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:46:26 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:46:26 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:46:26 user nova-compute[73476]:       <nova:owner>
Aug 26 20:46:26 user nova-compute[73476]:         <nova:user uuid="eb63707c9d734bf5b1d1bb20162e3204">tempest-ServerRescueNegativeTestJSON-552908196-project-member</nova:user>
Aug 26 20:46:26 user nova-compute[73476]:         <nova:project uuid="c713d9f0cc5f4dd7a8629ba1b27e72f0">tempest-ServerRescueNegativeTestJSON-552908196</nova:project>
Aug 26 20:46:26 user nova-compute[73476]:       </nova:owner>
Aug 26 20:46:26 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:46:26 user nova-compute[73476]:       <nova:ports>
Aug 26 20:46:26 user nova-compute[73476]:         <nova:port uuid="f21f3f69-c470-4a8e-9166-7b8a4dee07fb">
Aug 26 20:46:26 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 20:46:26 user nova-compute[73476]:         </nova:port>
Aug 26 20:46:26 user nova-compute[73476]:       </nova:ports>
Aug 26 20:46:26 user nova-compute[73476]:     </nova:instance>
Aug 26 20:46:26 user nova-compute[73476]:   </metadata>
Aug 26 20:46:26 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:46:26 user nova-compute[73476]:     <system>
Aug 26 20:46:26 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:46:26 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:46:26 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:46:26 user nova-compute[73476]:       <entry name="serial">531953d6-502b-4f11-8a53-0bf267bec1f0</entry>
Aug 26 20:46:26 user nova-compute[73476]:       <entry name="uuid">531953d6-502b-4f11-8a53-0bf267bec1f0</entry>
Aug 26 20:46:26 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:46:26 user nova-compute[73476]:     </system>
Aug 26 20:46:26 user nova-compute[73476]:   </sysinfo>
Aug 26 20:46:26 user nova-compute[73476]:   <os>
Aug 26 20:46:26 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:46:26 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:46:26 user nova-compute[73476]:   </os>
Aug 26 20:46:26 user nova-compute[73476]:   <features>
Aug 26 20:46:26 user nova-compute[73476]:     <acpi/>
Aug 26 20:46:26 user nova-compute[73476]:     <apic/>
Aug 26 20:46:26 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:46:26 user nova-compute[73476]:   </features>
Aug 26 20:46:26 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:46:26 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:46:26 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:46:26 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:46:26 user nova-compute[73476]:   </clock>
Aug 26 20:46:26 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:46:26 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:46:26 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:46:26 user nova-compute[73476]:   </cpu>
Aug 26 20:46:26 user nova-compute[73476]:   <devices>
Aug 26 20:46:26 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:46:26 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:46:26 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue"/>
Aug 26 20:46:26 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:46:26 user nova-compute[73476]:     </disk>
Aug 26 20:46:26 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:46:26 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:46:26 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk"/>
Aug 26 20:46:26 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:46:26 user nova-compute[73476]:     </disk>
Aug 26 20:46:26 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:46:26 user nova-compute[73476]:       <mac address="fa:16:3e:00:c3:ed"/>
Aug 26 20:46:26 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:26 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:46:26 user nova-compute[73476]:       <target dev="tapf21f3f69-c4"/>
Aug 26 20:46:26 user nova-compute[73476]:     </interface>
Aug 26 20:46:26 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:46:26 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/console.log" append="off"/>
Aug 26 20:46:26 user nova-compute[73476]:     </serial>
Aug 26 20:46:26 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:46:26 user nova-compute[73476]:     <video>
Aug 26 20:46:26 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:26 user nova-compute[73476]:     </video>
Aug 26 20:46:26 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:46:26 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:46:26 user nova-compute[73476]:     </rng>
Aug 26 20:46:26 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:46:26 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:46:26 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:46:26 user nova-compute[73476]:     </memballoon>
Aug 26 20:46:26 user nova-compute[73476]:   </devices>
Aug 26 20:46:26 user nova-compute[73476]: </domain>
Aug 26 20:46:26 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:26 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Instance destroyed successfully.
Aug 26 20:46:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No VIF found with MAC fa:16:3e:00:c3:ed, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:46:26 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:27 user nova-compute[73476]: WARNING nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state rescuing.
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:27 user nova-compute[73476]: WARNING nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state rescuing.
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:27 user nova-compute[73476]: WARNING nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state rescuing.
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:27 user nova-compute[73476]: WARNING nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state rescuing.
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:27 user nova-compute[73476]: WARNING nova.compute.manager [req-580ab83e-4581-4840-add1-4b9e71b4efcb req-a8f15ac4-52f7-4458-b680-a4081e7c0d5c service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state rescuing.
Aug 26 20:46:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:29 user nova-compute[73476]: WARNING nova.compute.manager [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state rescuing.
Aug 26 20:46:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:29 user nova-compute[73476]: WARNING nova.compute.manager [req-2cf53927-cf69-4ec0-94d8-fe7976ccead0 req-9c1fae83-1936-4cda-87a3-041b6bbc854b service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state active and task_state rescuing.
Aug 26 20:46:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:46:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:46:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:46:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for 531953d6-502b-4f11-8a53-0bf267bec1f0 due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:46:30 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082790.7725267, 531953d6-502b-4f11-8a53-0bf267bec1f0 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] VM Resumed (Lifecycle Event)
Aug 26 20:46:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6123dd7e-8a2e-41c1-9719-0f991a5cb826 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 20:46:30 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082790.7744157, 531953d6-502b-4f11-8a53-0bf267bec1f0 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:30 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] VM Started (Lifecycle Event)
Aug 26 20:46:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:31 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:46:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:31 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:46:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.311s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=7195MB free_disk=25.35879898071289GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Applying migration context for instance ad42cf47-42fb-488f-a44f-cf9824dd4d99 as it has an incoming, in-progress migration 1c6495dd-42aa-4c60-8ef3-a8b581a384c7. Migration status is finished {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 20:46:39 user nova-compute[73476]: INFO nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating resource usage from migration 1c6495dd-42aa-4c60-8ef3-a8b581a384c7
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22c72de3-e06b-4aae-bed9-162101a43e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance eaf9f058-2194-4e0e-9460-328108758c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Migration 1c6495dd-42aa-4c60-8ef3-a8b581a384c7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ad42cf47-42fb-488f-a44f-cf9824dd4d99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:46:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:46:40 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:46:40 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:46:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:46:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.882s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:46:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:46:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:46:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:46:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:46:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:44 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance_info_cache with network_info: [{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:46:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:46:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:46:50 user nova-compute[73476]: INFO nova.compute.claims [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Claim successful on node user
Aug 26 20:46:50 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:46:51 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:46:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG nova.policy [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecd8ed063c144eb694017e5750ee57a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98519bcea11642e6b491b3a0cb4616db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:46:51 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Creating image(s)
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "/opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "/opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "/opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.244s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk 1073741824" returned: 0 in 0.051s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.229s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:46:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Successfully created port: 5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Cannot resize image /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Ensure instance console log exists: /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG nova.network.neutron [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Successfully updated port: 5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "refresh_cache-820f7ca5-8bf5-494d-8dae-b0ee3431f156" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquired lock "refresh_cache-820f7ca5-8bf5-494d-8dae-b0ee3431f156" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:46:52 user nova-compute[73476]: DEBUG nova.network.neutron [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.compute.manager [req-46490856-908e-4878-95a4-0b5be0ab4824 req-5f4d2dd8-a83f-4720-97e9-cee4aaeb0159 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received event network-changed-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.compute.manager [req-46490856-908e-4878-95a4-0b5be0ab4824 req-5f4d2dd8-a83f-4720-97e9-cee4aaeb0159 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Refreshing instance network info cache due to event network-changed-5cab1496-d1b3-4d92-858e-d193a55c29cc. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-46490856-908e-4878-95a4-0b5be0ab4824 req-5f4d2dd8-a83f-4720-97e9-cee4aaeb0159 service nova] Acquiring lock "refresh_cache-820f7ca5-8bf5-494d-8dae-b0ee3431f156" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Updating instance_info_cache with network_info: [{"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Releasing lock "refresh_cache-820f7ca5-8bf5-494d-8dae-b0ee3431f156" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Instance network_info: |[{"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-46490856-908e-4878-95a4-0b5be0ab4824 req-5f4d2dd8-a83f-4720-97e9-cee4aaeb0159 service nova] Acquired lock "refresh_cache-820f7ca5-8bf5-494d-8dae-b0ee3431f156" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.network.neutron [req-46490856-908e-4878-95a4-0b5be0ab4824 req-5f4d2dd8-a83f-4720-97e9-cee4aaeb0159 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Refreshing network info cache for port 5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Start _get_guest_xml network_info=[{"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:46:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-588705009',display_name='tempest-AttachVolumeNegativeTest-server-588705009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-588705009',id=17,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+5+NqK3uyNpW36c/sHNBeDB7ty4MpoZfbTYyW9hggYFkw7mFXurk5iPO88TObGL18EskuijzXLbAKoEk82PZ2RkI77zFpq6F7f+s7H+irMXNRqqCuuycE/PgoDx/Squg==',key_name='tempest-keypair-1804821331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-ln6ai8j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:46:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=820f7ca5-8bf5-494d-8dae-b0ee3431f156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:3d:52,bridge_name='br-int',has_traffic_filtering=True,id=5cab1496-d1b3-4d92-858e-d193a55c29cc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab1496-d1') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.objects.instance [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'pci_devices' on Instance uuid 820f7ca5-8bf5-494d-8dae-b0ee3431f156 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:46:53 user nova-compute[73476]:   <uuid>820f7ca5-8bf5-494d-8dae-b0ee3431f156</uuid>
Aug 26 20:46:53 user nova-compute[73476]:   <name>instance-00000011</name>
Aug 26 20:46:53 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:46:53 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:46:53 user nova-compute[73476]:   <metadata>
Aug 26 20:46:53 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:46:53 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:46:53 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeNegativeTest-server-588705009</nova:name>
Aug 26 20:46:53 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:46:53</nova:creationTime>
Aug 26 20:46:53 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:46:53 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:46:53 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:46:53 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:46:53 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:46:53 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:46:53 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:46:53 user nova-compute[73476]:       <nova:owner>
Aug 26 20:46:53 user nova-compute[73476]:         <nova:user uuid="ecd8ed063c144eb694017e5750ee57a9">tempest-AttachVolumeNegativeTest-745835648-project-member</nova:user>
Aug 26 20:46:53 user nova-compute[73476]:         <nova:project uuid="98519bcea11642e6b491b3a0cb4616db">tempest-AttachVolumeNegativeTest-745835648</nova:project>
Aug 26 20:46:53 user nova-compute[73476]:       </nova:owner>
Aug 26 20:46:53 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:46:53 user nova-compute[73476]:       <nova:ports>
Aug 26 20:46:53 user nova-compute[73476]:         <nova:port uuid="5cab1496-d1b3-4d92-858e-d193a55c29cc">
Aug 26 20:46:53 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 20:46:53 user nova-compute[73476]:         </nova:port>
Aug 26 20:46:53 user nova-compute[73476]:       </nova:ports>
Aug 26 20:46:53 user nova-compute[73476]:     </nova:instance>
Aug 26 20:46:53 user nova-compute[73476]:   </metadata>
Aug 26 20:46:53 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:46:53 user nova-compute[73476]:     <system>
Aug 26 20:46:53 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:46:53 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:46:53 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:46:53 user nova-compute[73476]:       <entry name="serial">820f7ca5-8bf5-494d-8dae-b0ee3431f156</entry>
Aug 26 20:46:53 user nova-compute[73476]:       <entry name="uuid">820f7ca5-8bf5-494d-8dae-b0ee3431f156</entry>
Aug 26 20:46:53 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:46:53 user nova-compute[73476]:     </system>
Aug 26 20:46:53 user nova-compute[73476]:   </sysinfo>
Aug 26 20:46:53 user nova-compute[73476]:   <os>
Aug 26 20:46:53 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:46:53 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:46:53 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:46:53 user nova-compute[73476]:   </os>
Aug 26 20:46:53 user nova-compute[73476]:   <features>
Aug 26 20:46:53 user nova-compute[73476]:     <acpi/>
Aug 26 20:46:53 user nova-compute[73476]:     <apic/>
Aug 26 20:46:53 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:46:53 user nova-compute[73476]:   </features>
Aug 26 20:46:53 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:46:53 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:46:53 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:46:53 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:46:53 user nova-compute[73476]:   </clock>
Aug 26 20:46:53 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:46:53 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:46:53 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:46:53 user nova-compute[73476]:   </cpu>
Aug 26 20:46:53 user nova-compute[73476]:   <devices>
Aug 26 20:46:53 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:46:53 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:46:53 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk"/>
Aug 26 20:46:53 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:46:53 user nova-compute[73476]:     </disk>
Aug 26 20:46:53 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:46:53 user nova-compute[73476]:       <mac address="fa:16:3e:4f:3d:52"/>
Aug 26 20:46:53 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:53 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:46:53 user nova-compute[73476]:       <target dev="tap5cab1496-d1"/>
Aug 26 20:46:53 user nova-compute[73476]:     </interface>
Aug 26 20:46:53 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:46:53 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/console.log" append="off"/>
Aug 26 20:46:53 user nova-compute[73476]:     </serial>
Aug 26 20:46:53 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:46:53 user nova-compute[73476]:     <video>
Aug 26 20:46:53 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:46:53 user nova-compute[73476]:     </video>
Aug 26 20:46:53 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:46:53 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:46:53 user nova-compute[73476]:     </rng>
Aug 26 20:46:53 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:46:53 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:46:53 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:46:53 user nova-compute[73476]:     </memballoon>
Aug 26 20:46:53 user nova-compute[73476]:   </devices>
Aug 26 20:46:53 user nova-compute[73476]: </domain>
Aug 26 20:46:53 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-588705009',display_name='tempest-AttachVolumeNegativeTest-server-588705009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-588705009',id=17,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+5+NqK3uyNpW36c/sHNBeDB7ty4MpoZfbTYyW9hggYFkw7mFXurk5iPO88TObGL18EskuijzXLbAKoEk82PZ2RkI77zFpq6F7f+s7H+irMXNRqqCuuycE/PgoDx/Squg==',key_name='tempest-keypair-1804821331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-ln6ai8j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:46:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=820f7ca5-8bf5-494d-8dae-b0ee3431f156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:3d:52,bridge_name='br-int',has_traffic_filtering=True,id=5cab1496-d1b3-4d92-858e-d193a55c29cc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab1496-d1') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG os_vif [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:3d:52,bridge_name='br-int',has_traffic_filtering=True,id=5cab1496-d1b3-4d92-858e-d193a55c29cc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab1496-d1') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cab1496-d1, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cab1496-d1, col_values=(('external_ids', {'iface-id': '5cab1496-d1b3-4d92-858e-d193a55c29cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:3d:52', 'vm-uuid': '820f7ca5-8bf5-494d-8dae-b0ee3431f156'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:53 user nova-compute[73476]: INFO os_vif [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:3d:52,bridge_name='br-int',has_traffic_filtering=True,id=5cab1496-d1b3-4d92-858e-d193a55c29cc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab1496-d1')
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No VIF found with MAC fa:16:3e:4f:3d:52, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.network.neutron [req-46490856-908e-4878-95a4-0b5be0ab4824 req-5f4d2dd8-a83f-4720-97e9-cee4aaeb0159 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Updated VIF entry in instance network info cache for port 5cab1496-d1b3-4d92-858e-d193a55c29cc. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:46:53 user nova-compute[73476]: DEBUG nova.network.neutron [req-46490856-908e-4878-95a4-0b5be0ab4824 req-5f4d2dd8-a83f-4720-97e9-cee4aaeb0159 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Updating instance_info_cache with network_info: [{"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:46:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-46490856-908e-4878-95a4-0b5be0ab4824 req-5f4d2dd8-a83f-4720-97e9-cee4aaeb0159 service nova] Releasing lock "refresh_cache-820f7ca5-8bf5-494d-8dae-b0ee3431f156" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:46:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-e6c26850-a1c0-40f8-8af7-c42fbd54f7dc req-57fe2844-a550-4b9b-ad0e-5cfef3477820 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received event network-vif-plugged-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e6c26850-a1c0-40f8-8af7-c42fbd54f7dc req-57fe2844-a550-4b9b-ad0e-5cfef3477820 service nova] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e6c26850-a1c0-40f8-8af7-c42fbd54f7dc req-57fe2844-a550-4b9b-ad0e-5cfef3477820 service nova] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e6c26850-a1c0-40f8-8af7-c42fbd54f7dc req-57fe2844-a550-4b9b-ad0e-5cfef3477820 service nova] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-e6c26850-a1c0-40f8-8af7-c42fbd54f7dc req-57fe2844-a550-4b9b-ad0e-5cfef3477820 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] No waiting events found dispatching network-vif-plugged-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:55 user nova-compute[73476]: WARNING nova.compute.manager [req-e6c26850-a1c0-40f8-8af7-c42fbd54f7dc req-57fe2844-a550-4b9b-ad0e-5cfef3477820 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received unexpected event network-vif-plugged-5cab1496-d1b3-4d92-858e-d193a55c29cc for instance with vm_state building and task_state spawning.
Aug 26 20:46:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082817.6750724, 820f7ca5-8bf5-494d-8dae-b0ee3431f156 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] VM Resumed (Lifecycle Event)
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:57 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Instance spawned successfully.
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:46:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082817.6794102, 820f7ca5-8bf5-494d-8dae-b0ee3431f156 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:46:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] VM Started (Lifecycle Event)
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:46:57 user nova-compute[73476]: INFO nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Took 6.66 seconds to spawn the instance on the hypervisor.
Aug 26 20:46:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:46:57 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:46:57 user nova-compute[73476]: INFO nova.compute.manager [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Took 7.59 seconds to build instance.
Aug 26 20:46:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-766e5156-7b68-41be-a2dd-4cf737f5e749 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.696s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-4ef83cd3-0548-4696-a649-15fd091d7974 req-1596858d-ca30-47af-b8b3-30c980b46d17 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received event network-vif-plugged-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:46:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4ef83cd3-0548-4696-a649-15fd091d7974 req-1596858d-ca30-47af-b8b3-30c980b46d17 service nova] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:46:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4ef83cd3-0548-4696-a649-15fd091d7974 req-1596858d-ca30-47af-b8b3-30c980b46d17 service nova] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:46:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4ef83cd3-0548-4696-a649-15fd091d7974 req-1596858d-ca30-47af-b8b3-30c980b46d17 service nova] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:46:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-4ef83cd3-0548-4696-a649-15fd091d7974 req-1596858d-ca30-47af-b8b3-30c980b46d17 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] No waiting events found dispatching network-vif-plugged-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:46:58 user nova-compute[73476]: WARNING nova.compute.manager [req-4ef83cd3-0548-4696-a649-15fd091d7974 req-1596858d-ca30-47af-b8b3-30c980b46d17 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received unexpected event network-vif-plugged-5cab1496-d1b3-4d92-858e-d193a55c29cc for instance with vm_state active and task_state None.
Aug 26 20:46:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:46:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:47:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:07 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:47:07 user nova-compute[73476]: INFO nova.compute.claims [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Claim successful on node user
Aug 26 20:47:08 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:47:08 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 20:47:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG nova.policy [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64fb59ef9cc84f91a176089579e4ff5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd406b8ee798404f8c2cf2837e842ecf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:47:08 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Creating image(s)
Aug 26 20:47:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "/opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "/opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "/opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "25d3a86643d84fab17f9bc2bab41e0f9fea55f0a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "25d3a86643d84fab17f9bc2bab41e0f9fea55f0a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a.part --force-share --output=json" returned: 0 in 0.214s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG nova.virt.images [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] 8b32666b-b813-446e-83be-07f6d56cbd2b was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a.part /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a.part /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a.converted" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Successfully created port: fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "25d3a86643d84fab17f9bc2bab41e0f9fea55f0a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.089s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a --force-share --output=json" returned: 0 in 0.261s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "25d3a86643d84fab17f9bc2bab41e0f9fea55f0a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "25d3a86643d84fab17f9bc2bab41e0f9fea55f0a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a,backing_fmt=raw /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a,backing_fmt=raw /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk 1073741824" returned: 0 in 0.056s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "25d3a86643d84fab17f9bc2bab41e0f9fea55f0a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:10 user nova-compute[73476]: INFO nova.compute.manager [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Terminating instance
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a --force-share --output=json" returned: 0 in 0.213s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Successfully updated port: fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "refresh_cache-669c98c1-efd4-4119-8ad1-6adc20eb210d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquired lock "refresh_cache-669c98c1-efd4-4119-8ad1-6adc20eb210d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-22f9cec0-3bcf-4b8c-9322-ecd81c0ea3c9 req-f06123b8-4052-4e0c-9f10-4e9b71b3fd5b service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received event network-changed-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-22f9cec0-3bcf-4b8c-9322-ecd81c0ea3c9 req-f06123b8-4052-4e0c-9f10-4e9b71b3fd5b service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Refreshing instance network info cache due to event network-changed-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-22f9cec0-3bcf-4b8c-9322-ecd81c0ea3c9 req-f06123b8-4052-4e0c-9f10-4e9b71b3fd5b service nova] Acquiring lock "refresh_cache-669c98c1-efd4-4119-8ad1-6adc20eb210d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Cannot resize image /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Ensure instance console log exists: /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-5eb61966-9825-4ed5-8646-d188c718beac req-07530969-5414-421c-bbe0-0fd148c46c6c service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received event network-vif-unplugged-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5eb61966-9825-4ed5-8646-d188c718beac req-07530969-5414-421c-bbe0-0fd148c46c6c service nova] Acquiring lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5eb61966-9825-4ed5-8646-d188c718beac req-07530969-5414-421c-bbe0-0fd148c46c6c service nova] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5eb61966-9825-4ed5-8646-d188c718beac req-07530969-5414-421c-bbe0-0fd148c46c6c service nova] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-5eb61966-9825-4ed5-8646-d188c718beac req-07530969-5414-421c-bbe0-0fd148c46c6c service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] No waiting events found dispatching network-vif-unplugged-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-5eb61966-9825-4ed5-8646-d188c718beac req-07530969-5414-421c-bbe0-0fd148c46c6c service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received event network-vif-unplugged-060363f6-386f-4d72-a85f-cd40470f2a87 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Updating instance_info_cache with network_info: [{"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Releasing lock "refresh_cache-669c98c1-efd4-4119-8ad1-6adc20eb210d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Instance network_info: |[{"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-22f9cec0-3bcf-4b8c-9322-ecd81c0ea3c9 req-f06123b8-4052-4e0c-9f10-4e9b71b3fd5b service nova] Acquired lock "refresh_cache-669c98c1-efd4-4119-8ad1-6adc20eb210d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.network.neutron [req-22f9cec0-3bcf-4b8c-9322-ecd81c0ea3c9 req-f06123b8-4052-4e0c-9f10-4e9b71b3fd5b service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Refreshing network info cache for port fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Start _get_guest_xml network_info=[{"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:47:01Z,direct_url=<?>,disk_format='qcow2',id=8b32666b-b813-446e-83be-07f6d56cbd2b,min_disk=0,min_ram=0,name='',owner='09d0b2a34b5e4050a670b3c2443a1530',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:47:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8b32666b-b813-446e-83be-07f6d56cbd2b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:47:10 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:47:10 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:47:01Z,direct_url=<?>,disk_format='qcow2',id=8b32666b-b813-446e-83be-07f6d56cbd2b,min_disk=0,min_ram=0,name='',owner='09d0b2a34b5e4050a670b3c2443a1530',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:47:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:47:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:47:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1726100241',display_name='tempest-AttachSCSIVolumeTestJSON-server-1726100241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1726100241',id=18,image_ref='8b32666b-b813-446e-83be-07f6d56cbd2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1LYHf30KEFC2f3LIiWvJd3ukH0XlZkbLyGC5YSSKf94hQT8mJ8S6UV3ua80YJAU8ukCR1/Sgs2r376BSAZunohaAHK5SftsE/DIG21BGU+MMVv2Oufw2wQsZxRZlM3oQ==',key_name='tempest-keypair-216997835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd406b8ee798404f8c2cf2837e842ecf',ramdisk_id='',reservation_id='r-dylatfo2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8b32666b-b813-446e-83be-07f6d56cbd2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-471782709',owner_user_name='tempest-AttachSCSIVolumeTestJSON-471782709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:47:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64fb59ef9cc84f91a176089579e4ff5c',uuid=669c98c1-efd4-4119-8ad1-6adc20eb210d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Converting VIF {"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:25:7c,bridge_name='br-int',has_traffic_filtering=True,id=fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc,network=Network(436e2baa-caf8-40a9-b8bf-394ee895b271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf5b765-7c') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lazy-loading 'pci_devices' on Instance uuid 669c98c1-efd4-4119-8ad1-6adc20eb210d {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:47:11 user nova-compute[73476]:   <uuid>669c98c1-efd4-4119-8ad1-6adc20eb210d</uuid>
Aug 26 20:47:11 user nova-compute[73476]:   <name>instance-00000012</name>
Aug 26 20:47:11 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:47:11 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:47:11 user nova-compute[73476]:   <metadata>
Aug 26 20:47:11 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:47:11 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:47:11 user nova-compute[73476]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1726100241</nova:name>
Aug 26 20:47:11 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:47:10</nova:creationTime>
Aug 26 20:47:11 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:47:11 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:47:11 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:47:11 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:47:11 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:47:11 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:47:11 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:47:11 user nova-compute[73476]:       <nova:owner>
Aug 26 20:47:11 user nova-compute[73476]:         <nova:user uuid="64fb59ef9cc84f91a176089579e4ff5c">tempest-AttachSCSIVolumeTestJSON-471782709-project-member</nova:user>
Aug 26 20:47:11 user nova-compute[73476]:         <nova:project uuid="cd406b8ee798404f8c2cf2837e842ecf">tempest-AttachSCSIVolumeTestJSON-471782709</nova:project>
Aug 26 20:47:11 user nova-compute[73476]:       </nova:owner>
Aug 26 20:47:11 user nova-compute[73476]:       <nova:root type="image" uuid="8b32666b-b813-446e-83be-07f6d56cbd2b"/>
Aug 26 20:47:11 user nova-compute[73476]:       <nova:ports>
Aug 26 20:47:11 user nova-compute[73476]:         <nova:port uuid="fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc">
Aug 26 20:47:11 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 20:47:11 user nova-compute[73476]:         </nova:port>
Aug 26 20:47:11 user nova-compute[73476]:       </nova:ports>
Aug 26 20:47:11 user nova-compute[73476]:     </nova:instance>
Aug 26 20:47:11 user nova-compute[73476]:   </metadata>
Aug 26 20:47:11 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:47:11 user nova-compute[73476]:     <system>
Aug 26 20:47:11 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:47:11 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:47:11 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:47:11 user nova-compute[73476]:       <entry name="serial">669c98c1-efd4-4119-8ad1-6adc20eb210d</entry>
Aug 26 20:47:11 user nova-compute[73476]:       <entry name="uuid">669c98c1-efd4-4119-8ad1-6adc20eb210d</entry>
Aug 26 20:47:11 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:47:11 user nova-compute[73476]:     </system>
Aug 26 20:47:11 user nova-compute[73476]:   </sysinfo>
Aug 26 20:47:11 user nova-compute[73476]:   <os>
Aug 26 20:47:11 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:47:11 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:47:11 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:47:11 user nova-compute[73476]:   </os>
Aug 26 20:47:11 user nova-compute[73476]:   <features>
Aug 26 20:47:11 user nova-compute[73476]:     <acpi/>
Aug 26 20:47:11 user nova-compute[73476]:     <apic/>
Aug 26 20:47:11 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:47:11 user nova-compute[73476]:   </features>
Aug 26 20:47:11 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:47:11 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:47:11 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:47:11 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:47:11 user nova-compute[73476]:   </clock>
Aug 26 20:47:11 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:47:11 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:47:11 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:47:11 user nova-compute[73476]:   </cpu>
Aug 26 20:47:11 user nova-compute[73476]:   <devices>
Aug 26 20:47:11 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:47:11 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:47:11 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk"/>
Aug 26 20:47:11 user nova-compute[73476]:       <target dev="sda" bus="scsi"/>
Aug 26 20:47:11 user nova-compute[73476]:       <address type="drive" controller="0" unit="0"/>
Aug 26 20:47:11 user nova-compute[73476]:     </disk>
Aug 26 20:47:11 user nova-compute[73476]:     <disk type="file" device="cdrom">
Aug 26 20:47:11 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 20:47:11 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk.config"/>
Aug 26 20:47:11 user nova-compute[73476]:       <target dev="sdb" bus="scsi"/>
Aug 26 20:47:11 user nova-compute[73476]:       <address type="drive" controller="0" unit="1"/>
Aug 26 20:47:11 user nova-compute[73476]:     </disk>
Aug 26 20:47:11 user nova-compute[73476]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 20:47:11 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:47:11 user nova-compute[73476]:       <mac address="fa:16:3e:ae:25:7c"/>
Aug 26 20:47:11 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:47:11 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:47:11 user nova-compute[73476]:       <target dev="tapfdf5b765-7c"/>
Aug 26 20:47:11 user nova-compute[73476]:     </interface>
Aug 26 20:47:11 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:47:11 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/console.log" append="off"/>
Aug 26 20:47:11 user nova-compute[73476]:     </serial>
Aug 26 20:47:11 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:47:11 user nova-compute[73476]:     <video>
Aug 26 20:47:11 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:47:11 user nova-compute[73476]:     </video>
Aug 26 20:47:11 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:47:11 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:47:11 user nova-compute[73476]:     </rng>
Aug 26 20:47:11 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:47:11 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:47:11 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:47:11 user nova-compute[73476]:     </memballoon>
Aug 26 20:47:11 user nova-compute[73476]:   </devices>
Aug 26 20:47:11 user nova-compute[73476]: </domain>
Aug 26 20:47:11 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:47:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1726100241',display_name='tempest-AttachSCSIVolumeTestJSON-server-1726100241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1726100241',id=18,image_ref='8b32666b-b813-446e-83be-07f6d56cbd2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1LYHf30KEFC2f3LIiWvJd3ukH0XlZkbLyGC5YSSKf94hQT8mJ8S6UV3ua80YJAU8ukCR1/Sgs2r376BSAZunohaAHK5SftsE/DIG21BGU+MMVv2Oufw2wQsZxRZlM3oQ==',key_name='tempest-keypair-216997835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd406b8ee798404f8c2cf2837e842ecf',ramdisk_id='',reservation_id='r-dylatfo2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8b32666b-b813-446e-83be-07f6d56cbd2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-471782709',owner_user_name='tempest-AttachSCSIVolumeTestJSON-471782709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:47:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64fb59ef9cc84f91a176089579e4ff5c',uuid=669c98c1-efd4-4119-8ad1-6adc20eb210d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Converting VIF {"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:25:7c,bridge_name='br-int',has_traffic_filtering=True,id=fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc,network=Network(436e2baa-caf8-40a9-b8bf-394ee895b271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf5b765-7c') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG os_vif [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:25:7c,bridge_name='br-int',has_traffic_filtering=True,id=fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc,network=Network(436e2baa-caf8-40a9-b8bf-394ee895b271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf5b765-7c') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdf5b765-7c, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdf5b765-7c, col_values=(('external_ids', {'iface-id': 'fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:25:7c', 'vm-uuid': '669c98c1-efd4-4119-8ad1-6adc20eb210d'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:47:11 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Instance destroyed successfully.
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lazy-loading 'resources' on Instance uuid adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-290381088',display_name='tempest-VolumesAdminNegativeTest-server-290381088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-290381088',id=13,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:45:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0b92247b70b4ef6ab0d4bbb6a8a60f0',ramdisk_id='',reservation_id='r-tuy5h5tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1926983424',owner_user_name='tempest-VolumesAdminNegativeTest-1926983424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:45:13Z,user_data=None,user_id='0f2bee4738d4442fabd6c6a802070555',uuid=adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converting VIF {"id": "060363f6-386f-4d72-a85f-cd40470f2a87", "address": "fa:16:3e:91:f2:21", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060363f6-38", "ovs_interfaceid": "060363f6-386f-4d72-a85f-cd40470f2a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=060363f6-386f-4d72-a85f-cd40470f2a87,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060363f6-38') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG os_vif [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=060363f6-386f-4d72-a85f-cd40470f2a87,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060363f6-38') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:11 user nova-compute[73476]: INFO os_vif [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:25:7c,bridge_name='br-int',has_traffic_filtering=True,id=fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc,network=Network(436e2baa-caf8-40a9-b8bf-394ee895b271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf5b765-7c')
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap060363f6-38, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:11 user nova-compute[73476]: INFO os_vif [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=060363f6-386f-4d72-a85f-cd40470f2a87,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060363f6-38')
Aug 26 20:47:11 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Deleting instance files /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1_del
Aug 26 20:47:11 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Deletion of /opt/stack/data/nova/instances/adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1_del complete
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] No BDM found with device name sda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] No VIF found with MAC fa:16:3e:ae:25:7c, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:47:11 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Using config drive
Aug 26 20:47:11 user nova-compute[73476]: INFO nova.compute.manager [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 26 20:47:11 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:47:11 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Creating config drive at /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk.config
Aug 26 20:47:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe5kvrysz {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe5kvrysz" returned: 0 in 0.073s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.network.neutron [req-22f9cec0-3bcf-4b8c-9322-ecd81c0ea3c9 req-f06123b8-4052-4e0c-9f10-4e9b71b3fd5b service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Updated VIF entry in instance network info cache for port fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG nova.network.neutron [req-22f9cec0-3bcf-4b8c-9322-ecd81c0ea3c9 req-f06123b8-4052-4e0c-9f10-4e9b71b3fd5b service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Updating instance_info_cache with network_info: [{"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:47:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-22f9cec0-3bcf-4b8c-9322-ecd81c0ea3c9 req-f06123b8-4052-4e0c-9f10-4e9b71b3fd5b service nova] Releasing lock "refresh_cache-669c98c1-efd4-4119-8ad1-6adc20eb210d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:47:12 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:47:12 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Took 1.07 seconds to deallocate network for instance.
Aug 26 20:47:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-3e2d75e2-ff8c-4b2d-9799-347883d14927 req-6b13ef4a-c571-4954-b716-214a3bb7b39b service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received event network-vif-deleted-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-db676512-6eed-4b4f-a9c3-cf3c2c9cd4fb req-ccf93be0-a08f-4dd9-8cc7-36eb227c1259 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received event network-vif-plugged-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-db676512-6eed-4b4f-a9c3-cf3c2c9cd4fb req-ccf93be0-a08f-4dd9-8cc7-36eb227c1259 service nova] Acquiring lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-db676512-6eed-4b4f-a9c3-cf3c2c9cd4fb req-ccf93be0-a08f-4dd9-8cc7-36eb227c1259 service nova] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-db676512-6eed-4b4f-a9c3-cf3c2c9cd4fb req-ccf93be0-a08f-4dd9-8cc7-36eb227c1259 service nova] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-db676512-6eed-4b4f-a9c3-cf3c2c9cd4fb req-ccf93be0-a08f-4dd9-8cc7-36eb227c1259 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] No waiting events found dispatching network-vif-plugged-060363f6-386f-4d72-a85f-cd40470f2a87 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:12 user nova-compute[73476]: WARNING nova.compute.manager [req-db676512-6eed-4b4f-a9c3-cf3c2c9cd4fb req-ccf93be0-a08f-4dd9-8cc7-36eb227c1259 service nova] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Received unexpected event network-vif-plugged-060363f6-386f-4d72-a85f-cd40470f2a87 for instance with vm_state deleted and task_state None.
Aug 26 20:47:13 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.700s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:13 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Deleted allocations for instance adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1
Aug 26 20:47:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7003adc-e53b-46da-bc3d-c7ac336cafec tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.125s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-be39d895-6b7d-480b-a83a-a56f3a86a69a req-c2fe1210-953c-4a4b-af10-8b39b7d517b1 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-changed-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-be39d895-6b7d-480b-a83a-a56f3a86a69a req-c2fe1210-953c-4a4b-af10-8b39b7d517b1 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Refreshing instance network info cache due to event network-changed-920e6ff4-145c-41b3-b513-49437e60144b. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-be39d895-6b7d-480b-a83a-a56f3a86a69a req-c2fe1210-953c-4a4b-af10-8b39b7d517b1 service nova] Acquiring lock "refresh_cache-eaf9f058-2194-4e0e-9460-328108758c42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-be39d895-6b7d-480b-a83a-a56f3a86a69a req-c2fe1210-953c-4a4b-af10-8b39b7d517b1 service nova] Acquired lock "refresh_cache-eaf9f058-2194-4e0e-9460-328108758c42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:47:13 user nova-compute[73476]: DEBUG nova.network.neutron [req-be39d895-6b7d-480b-a83a-a56f3a86a69a req-c2fe1210-953c-4a4b-af10-8b39b7d517b1 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Refreshing network info cache for port 920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG nova.objects.instance [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'flavor' on Instance uuid eaf9f058-2194-4e0e-9460-328108758c42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG nova.network.neutron [req-be39d895-6b7d-480b-a83a-a56f3a86a69a req-c2fe1210-953c-4a4b-af10-8b39b7d517b1 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Updated VIF entry in instance network info cache for port 920e6ff4-145c-41b3-b513-49437e60144b. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG nova.network.neutron [req-be39d895-6b7d-480b-a83a-a56f3a86a69a req-c2fe1210-953c-4a4b-af10-8b39b7d517b1 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Updating instance_info_cache with network_info: [{"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-be39d895-6b7d-480b-a83a-a56f3a86a69a req-c2fe1210-953c-4a4b-af10-8b39b7d517b1 service nova] Releasing lock "refresh_cache-eaf9f058-2194-4e0e-9460-328108758c42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:14 user nova-compute[73476]: INFO nova.compute.manager [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Attaching volume 241e27f5-1d23-4802-9866-3f66f16c0fbc to /dev/vdb
Aug 26 20:47:14 user nova-compute[73476]: DEBUG os_brick.utils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac90bc9-d13a-4973-b3f3-1743609a2674]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cc508a-f3e3-48be-9d3c-541a34cba53d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e102681f-0259-4283-962a-ff14c58852fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd353da-2bee-4e90-9e72-f740a6bd2a90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:47:14 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:47:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[632e58c5-55dc-45fb-9c88-bea05bf2fde5]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG os_brick.utils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:14 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Updating existing volume attachment record: 473ef71f-0cf7-49e5-99e6-83d07da43785 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received event network-vif-plugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] No waiting events found dispatching network-vif-plugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:15 user nova-compute[73476]: WARNING nova.compute.manager [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received unexpected event network-vif-plugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc for instance with vm_state building and task_state spawning.
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received event network-vif-plugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] No waiting events found dispatching network-vif-plugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:15 user nova-compute[73476]: WARNING nova.compute.manager [req-7e294ada-cca2-4fdc-aee1-b768526a53cd req-4f897a40-945c-4437-92fe-74c140ba32bf service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received unexpected event network-vif-plugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc for instance with vm_state building and task_state spawning.
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082835.8453681, 669c98c1-efd4-4119-8ad1-6adc20eb210d => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:47:15 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] VM Resumed (Lifecycle Event)
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:47:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Instance spawned successfully.
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:47:15 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082835.8599055, 669c98c1-efd4-4119-8ad1-6adc20eb210d => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:47:15 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] VM Started (Lifecycle Event)
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:47:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:47:16 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:47:16 user nova-compute[73476]: INFO nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Took 7.58 seconds to spawn the instance on the hypervisor.
Aug 26 20:47:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:47:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:16 user nova-compute[73476]: INFO nova.compute.manager [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Took 8.70 seconds to build instance.
Aug 26 20:47:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d74b0177-e463-40b1-8065-1593a2667386 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.857s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:23 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:24 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:47:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:26 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082831.0636518, adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:47:26 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] VM Stopped (Lifecycle Event)
Aug 26 20:47:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-86a5a514-4e39-46fc-82b4-6ccdece3f835 None None] [instance: adc2fcff-4fec-49ef-8a3b-48b1ba0f98a1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:47:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtUBXPfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:27 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:47:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:47:27 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:47:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:47:27 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:47:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8300c99f-cae0-4ab5-93f2-5f6ea256480a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:47:27 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d89bf-1bb6-4259-bcd5-e9d857a4e1c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc] added
Aug 26 20:47:27 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5cdfe6-7257-47f9-9a30-1fec5ee80069]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7ed955-0d4c-448e-ae84-cb74b80660d5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtUBXPfw {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtUBXPfw" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b5681e-a062-4d50-89f7-df0a2cfdde5b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtUBXPfw'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[769bdf5e-7241-490c-9589-b9df2610d767]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f5627d-fbab-48f0-8ed7-ad6f83fcaaeb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:28 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:28 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c4f72-e4d4-40b9-ba33-1108b7da031f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260]
Aug 26 20:47:28 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260] successful.
Aug 26 20:47:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b48a1f-53b8-4428-a2c5-06c2c1079323]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[833500c0-3842-49e7-beaf-c6a6261c3923]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:28 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:28 user nova-compute[73476]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:28 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:28 user nova-compute[73476]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a68ed-7b05-4620-a6f4-97a0eccbad2c]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtUBXPfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:28 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73476) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23436353039343535', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436353039343535', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG nova.objects.instance [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'flavor' on Instance uuid eaf9f058-2194-4e0e-9460-328108758c42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:47:29 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:47:29 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 20:47:29 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:47:29 user nova-compute[73476]:   <serial>241e27f5-1d23-4802-9866-3f66f16c0fbc</serial>
Aug 26 20:47:29 user nova-compute[73476]: </disk>
Aug 26 20:47:29 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No VIF found with MAC fa:16:3e:1c:de:05, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:47:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ad8b16bf-5504-44f5-a182-94d900325f93 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.359s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:31 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:31 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:31 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 20:47:31 user nova-compute[73476]: INFO nova.compute.manager [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Rebuilding instance
Aug 26 20:47:31 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] There are 0 instances to clean {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 20:47:31 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:47:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:32 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Instance destroyed successfully.
Aug 26 20:47:32 user nova-compute[73476]: INFO nova.compute.manager [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Detaching volume 241e27f5-1d23-4802-9866-3f66f16c0fbc
Aug 26 20:47:32 user nova-compute[73476]: INFO nova.virt.block_device [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Attempting to driver detach volume 241e27f5-1d23-4802-9866-3f66f16c0fbc from mountpoint /dev/vdb
Aug 26 20:47:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Attempting to detach device vdb from instance eaf9f058-2194-4e0e-9460-328108758c42 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:47:32 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:47:32 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 20:47:32 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:47:32 user nova-compute[73476]:   <serial>241e27f5-1d23-4802-9866-3f66f16c0fbc</serial>
Aug 26 20:47:32 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:47:32 user nova-compute[73476]: </disk>
Aug 26 20:47:32 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:47:32 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully detached device vdb from instance eaf9f058-2194-4e0e-9460-328108758c42 from the persistent domain config.
Aug 26 20:47:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtUBXPfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:32 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 20:47:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[67497645-4733-46bc-b575-71ea315929f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32aecfd-87a4-40b0-a811-2c3682f835ca]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:33 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:33 user nova-compute[73476]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:33 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:33 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:33 user nova-compute[73476]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:33 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b00fe0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[07552846-9412-4498-8f35-1069c127c0b8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[11490393-419f-422d-b952-0f11609ffb5e]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5565ffa-05f4-47a2-805c-80347903baee]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7be80c-b660-40cf-b27f-d4cc0e8b154e]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3eda87-75fd-4450-a54e-3857f20b32d0]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[54eb18db-ac1d-45b6-84bc-e8605aa3f89c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260]
Aug 26 20:47:33 user nova-compute[73476]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260] successful.
Aug 26 20:47:33 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcabaff-57d4-4d55-bbe1-6c938b04d440]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== disconnect_volume: return (339ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:47:33 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:47:34 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Instance destroyed successfully.
Aug 26 20:47:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-924396',display_name='tempest-ServerActionsTestOtherA-server-1638955500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-924396',id=14,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV/yd8kfxlaTWXrDZ3wbLsadxJe1f2WQOA3s+97nsG/XDorWSKUuwbAAV+UBcfNkZOqvbKg3jvF1sQHB2BfsglNHCVhOpK2aXH6Iq8Qok+VhT6HbE2h3S1fpQjHJ8cjDw==',key_name='tempest-keypair-710174093',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:45:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-qgortcq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:47:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=eaf9f058-2194-4e0e-9460-328108758c42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_vif [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap920e6ff4-14, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:34 user nova-compute[73476]: INFO os_vif [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14')
Aug 26 20:47:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtUBXPfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:34 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[082e2b96-3966-4b86-bda5-b722055e0ed2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef24ba2a-a46c-4493-88e7-9b8a5e45adb6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:34 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:34 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:34 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:34 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b0127880>, {}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Disconnecting from: [] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== disconnect_volume: return (57ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:47:34 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Deleting instance files /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42_del
Aug 26 20:47:34 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Deletion of /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42_del complete
Aug 26 20:47:34 user nova-compute[73476]: INFO nova.virt.block_device [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Booting with volume 241e27f5-1d23-4802-9866-3f66f16c0fbc at /dev/vdb
Aug 26 20:47:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.utils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[583f7b0a-a840-46f7-8f5f-622a216489ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7e4c06-f08d-4c90-aaa3-b6918998a6a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd282278-deba-4964-9a74-5d847fd7ac6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5788d965-4537-4b17-9f71-235cec583dc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:47:34 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed966a40-24ea-43d8-ab94-7a042edd1891]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG os_brick.utils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Updating existing volume attachment record: 0681b4d6-ce1f-415a-ac47-d8508036555b {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Updating instance_info_cache with network_info: [{"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:47:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-c6160494-5075-45b0-9250-99fe1cdca98b req-6d88ef6c-5842-421f-9e07-29379ade5604 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-unplugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c6160494-5075-45b0-9250-99fe1cdca98b req-6d88ef6c-5842-421f-9e07-29379ade5604 service nova] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c6160494-5075-45b0-9250-99fe1cdca98b req-6d88ef6c-5842-421f-9e07-29379ade5604 service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c6160494-5075-45b0-9250-99fe1cdca98b req-6d88ef6c-5842-421f-9e07-29379ade5604 service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-c6160494-5075-45b0-9250-99fe1cdca98b req-6d88ef6c-5842-421f-9e07-29379ade5604 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] No waiting events found dispatching network-vif-unplugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:35 user nova-compute[73476]: WARNING nova.compute.manager [req-c6160494-5075-45b0-9250-99fe1cdca98b req-6d88ef6c-5842-421f-9e07-29379ade5604 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received unexpected event network-vif-unplugged-920e6ff4-145c-41b3-b513-49437e60144b for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Port f0b59e8a-1964-4699-81f4-6a9c3b08dae0 binding to destination host user is already ACTIVE {{(pid=73476) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquired lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance_info_cache with network_info: [{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Releasing lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:47:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Creating tmpfile /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/tmpewi3lz8c to verify with other compute node that the instance is on the same shared storage. {{(pid=73476) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-70f7edcd-6762-4399-b8ce-e846fc2a6b37 req-0fba87f4-d80c-4b6a-8397-aa40f506cadc service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-70f7edcd-6762-4399-b8ce-e846fc2a6b37 req-0fba87f4-d80c-4b6a-8397-aa40f506cadc service nova] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-70f7edcd-6762-4399-b8ce-e846fc2a6b37 req-0fba87f4-d80c-4b6a-8397-aa40f506cadc service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-70f7edcd-6762-4399-b8ce-e846fc2a6b37 req-0fba87f4-d80c-4b6a-8397-aa40f506cadc service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-70f7edcd-6762-4399-b8ce-e846fc2a6b37 req-0fba87f4-d80c-4b6a-8397-aa40f506cadc service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] No waiting events found dispatching network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:37 user nova-compute[73476]: WARNING nova.compute.manager [req-70f7edcd-6762-4399-b8ce-e846fc2a6b37 req-0fba87f4-d80c-4b6a-8397-aa40f506cadc service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received unexpected event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 26 20:47:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance destroyed successfully.
Aug 26 20:47:37 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lazy-loading 'resources' on Instance uuid ad42cf47-42fb-488f-a44f-cf9824dd4d99 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-263678955',display_name='tempest-ServerActionsTestOtherB-server-263678955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-263678955',id=5,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6duovOgpoS/+TE0EH/fCNy+ilV5kxrulfvMaTJVTAkoOJVt3B0olv0pH7NT01fhQF+CMU3wUX3bGKgX/wKj8M/GNeOdqt2EwZ91VfdEmDAANieG8njlOp1SAEmAi7Ug==',key_name='tempest-keypair-1212818177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76a9f74cd94849f7a132c168b1ed5622',ramdisk_id='',reservation_id='r-ns6go6pz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-42689020',owner_user_name='tempest-ServerActionsTestOtherB-42689020-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18713e0a843f45f08cdb8d70e7cafeeb',uuid=ad42cf47-42fb-488f-a44f-cf9824dd4d99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converting VIF {"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG os_vif [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0b59e8a-19, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:47:37 user nova-compute[73476]: INFO os_vif [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19')
Aug 26 20:47:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:37 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:47:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d1aadb-3384-45d7-8118-82cf4f7ac630]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9297eda3-d051-4dcc-b889-90f51878f404]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:37 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:37 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:37 user nova-compute[73476]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:37 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b01924d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:47:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a09422-0538-4f0c-be5c-d3746087ad3b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba9874-e9d3-4018-ba5a-54a10ed18c48]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae33702-3cd1-402b-993b-586657357f69]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc4fef2-85d1-4361-8093-1b5f8570cca6]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[92528ac1-9bd7-4461-bbcf-3575ab5d78f4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4380badb-e492-4984-85a2-a847466607dc]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]
Aug 26 20:47:38 user nova-compute[73476]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.
Aug 26 20:47:38 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3995f726-caca-4314-b0c0-702d74906f86]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] <== disconnect_volume: return (388ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-7099816a-c149-425d-b6f1-c9a1708b834f req-ae64fe51-0392-4408-8fb3-f2ff18f038b5 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-unplugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7099816a-c149-425d-b6f1-c9a1708b834f req-ae64fe51-0392-4408-8fb3-f2ff18f038b5 service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7099816a-c149-425d-b6f1-c9a1708b834f req-ae64fe51-0392-4408-8fb3-f2ff18f038b5 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7099816a-c149-425d-b6f1-c9a1708b834f req-ae64fe51-0392-4408-8fb3-f2ff18f038b5 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-7099816a-c149-425d-b6f1-c9a1708b834f req-ae64fe51-0392-4408-8fb3-f2ff18f038b5 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-unplugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:39 user nova-compute[73476]: WARNING nova.compute.manager [req-7099816a-c149-425d-b6f1-c9a1708b834f req-ae64fe51-0392-4408-8fb3-f2ff18f038b5 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-unplugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state resized and task_state resize_reverting.
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lazy-loading 'migration_context' on Instance uuid ad42cf47-42fb-488f-a44f-cf9824dd4d99 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG nova.objects.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Object Instance<ad42cf47-42fb-488f-a44f-cf9824dd4d99> lazy-loaded attributes: resources,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Refreshing inventories for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Updating ProviderTree inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Refreshing aggregate associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, aggregates: None {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Refreshing trait associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.089s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:40 user nova-compute[73476]: INFO nova.compute.manager [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Swapping old allocation on dict_keys(['b505444b-68ee-4bd2-bfa2-81c3d587cc2d']) held by migration 1c6495dd-42aa-4c60-8ef3-a8b581a384c7 for instance
Aug 26 20:47:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:40 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Overwriting current allocation {'allocations': {'b505444b-68ee-4bd2-bfa2-81c3d587cc2d': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': '76a9f74cd94849f7a132c168b1ed5622', 'user_id': '18713e0a843f45f08cdb8d70e7cafeeb', 'consumer_generation': 1} on consumer ad42cf47-42fb-488f-a44f-cf9824dd4d99 {{(pid=73476) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-9e6eed07-1f20-4cc7-ba72-c6a808285a64 req-05bc17b2-042e-4f1a-8516-5b2e8db4599a service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e6eed07-1f20-4cc7-ba72-c6a808285a64 req-05bc17b2-042e-4f1a-8516-5b2e8db4599a service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e6eed07-1f20-4cc7-ba72-c6a808285a64 req-05bc17b2-042e-4f1a-8516-5b2e8db4599a service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e6eed07-1f20-4cc7-ba72-c6a808285a64 req-05bc17b2-042e-4f1a-8516-5b2e8db4599a service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-9e6eed07-1f20-4cc7-ba72-c6a808285a64 req-05bc17b2-042e-4f1a-8516-5b2e8db4599a service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:41 user nova-compute[73476]: WARNING nova.compute.manager [req-9e6eed07-1f20-4cc7-ba72-c6a808285a64 req-05bc17b2-042e-4f1a-8516-5b2e8db4599a service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state resized and task_state resize_reverting.
Aug 26 20:47:41 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:47:41 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=6853MB free_disk=25.24994659423828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquired lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ad42cf47-42fb-488f-a44f-cf9824dd4d99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance eaf9f058-2194-4e0e-9460-328108758c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 669c98c1-efd4-4119-8ad1-6adc20eb210d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22c72de3-e06b-4aae-bed9-162101a43e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:41 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.826s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance_info_cache with network_info: [{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Releasing lock "refresh_cache-ad42cf47-42fb-488f-a44f-cf9824dd4d99" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG os_brick.utils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7f06ac-3b55-443c-b518-04859ad3770a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a149bd80-9ba8-4953-aa23-77f720a04190]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15c1843-208e-4d4f-b911-8b42f18841b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf2797b-aae3-4968-a7b3-36e8a3d24124]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:47:43 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:47:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f803afc-7896-4ae1-a9ef-1666176df3ad]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:47:43 user nova-compute[73476]: DEBUG os_brick.utils [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:47 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082852.6961713, eaf9f058-2194-4e0e-9460-328108758c42 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:47:47 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] VM Stopped (Lifecycle Event)
Aug 26 20:47:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9f4c008e-4645-441d-83a3-5a48faf4839c None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:47:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:52 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082857.7793214, ad42cf47-42fb-488f-a44f-cf9824dd4d99 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:47:52 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] VM Stopped (Lifecycle Event)
Aug 26 20:47:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-67eb9630-6a7a-4371-a14d-81535f0f510e None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:47:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:47:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Creating image(s)
Aug 26 20:47:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk 1073741824" returned: 0 in 0.048s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Cannot resize image /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Ensure instance console log exists: /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Start _get_guest_xml network_info=[{"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '0681b4d6-ce1f-415a-ac47-d8508036555b', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtUBXPfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eaf9f058-2194-4e0e-9460-328108758c42', 'attached_at': '', 'detached_at': '', 'volume_id': '241e27f5-1d23-4802-9866-3f66f16c0fbc', 'serial': '241e27f5-1d23-4802-9866-3f66f16c0fbc'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:47:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 20:47:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'vcpu_model' on Instance uuid eaf9f058-2194-4e0e-9460-328108758c42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtUBXPfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:53 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:47:53 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:47:53 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f599c394-f463-4d08-a7bc-48fb2edb1f13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:47:53 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab39d5f-b733-43ea-84cc-06a4a36bf8d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc] added
Aug 26 20:47:53 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dff5e3-c68f-4bc7-8344-92e56bf18fdc]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e1f6b3-dcad-44b0-a9e0-9c963449b2fd]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtUBXPfw {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtUBXPfw" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d7b093-ecde-41bc-b1bc-55b2034ca016]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtUBXPfw'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec74dda-5de5-4b83-9615-eb4ddae3dcf8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[506301f8-8f00-4380-a0bc-cd310efd0df9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8e681c-7ede-4f7a-950e-28f9cbe22038]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260]
Aug 26 20:47:54 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260] successful.
Aug 26 20:47:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[896a76e7-3168-46a1-9f58-c3724e9aa46c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[28098a6b-7b02-4b16-8ef2-098452f71498]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:54 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:54 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beff1b8-3484-4f05-bf61-76aafb38bf1d]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'flavor' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Starting finish_revert_migration {{(pid=73476) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Start _get_guest_xml network_info=[{"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '622399f7-3698-4952-a365-7d747dad48c6', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ad42cf47-42fb-488f-a44f-cf9824dd4d99', 'attached_at': '2023-08-26T20:47:55.000000', 'detached_at': '', 'volume_id': '8809a5b6-d0f3-4f59-b94e-220073f5f4c2', 'serial': '8809a5b6-d0f3-4f59-b94e-220073f5f4c2'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:47:54 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:47:54 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad42cf47-42fb-488f-a44f-cf9824dd4d99 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:54 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:54 user nova-compute[73476]: INFO nova.compute.manager [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Attaching volume 971018e8-7d57-466a-a4cf-51465d1beabc to /dev/vdb
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.utils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[db80d9bf-6e62-4ea5-bfe4-f8e6c1b46dd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9de5947-8968-4543-9779-5b10ea82889e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af2425f-c87c-4a0b-be25-9b6508083675]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4c5dd5-a2fa-46dd-9109-20e48b927e49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:47:54 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:47:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f807691-1e4d-4a86-9f78-cb55ae760ea5]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG os_brick.utils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:54 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updating existing volume attachment record: fe922b11-9726-4a7b-92a7-37025e54061c {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtUBXPfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23436353039343535', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436353039343535', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.382s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:47:55 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:47:55 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[597603cb-e4a4-4ab7-b1a2-bc2b4075a547]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:47:55 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-924396',display_name='tempest-ServerActionsTestOtherA-server-1638955500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-924396',id=14,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV/yd8kfxlaTWXrDZ3wbLsadxJe1f2WQOA3s+97nsG/XDorWSKUuwbAAV+UBcfNkZOqvbKg3jvF1sQHB2BfsglNHCVhOpK2aXH6Iq8Qok+VhT6HbE2h3S1fpQjHJ8cjDw==',key_name='tempest-keypair-710174093',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:45:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-qgortcq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=eaf9f058-2194-4e0e-9460-328108758c42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:47:55 user nova-compute[73476]:   <uuid>eaf9f058-2194-4e0e-9460-328108758c42</uuid>
Aug 26 20:47:55 user nova-compute[73476]:   <name>instance-0000000e</name>
Aug 26 20:47:55 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:47:55 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:47:55 user nova-compute[73476]:   <metadata>
Aug 26 20:47:55 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:47:55 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:47:55 user nova-compute[73476]:       <nova:name>tempest-ServerActionsTestOtherA-server-1638955500</nova:name>
Aug 26 20:47:55 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:47:53</nova:creationTime>
Aug 26 20:47:55 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:47:55 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:47:55 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:47:55 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:47:55 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:47:55 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:47:55 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:47:55 user nova-compute[73476]:       <nova:owner>
Aug 26 20:47:55 user nova-compute[73476]:         <nova:user uuid="fdf18fb0dcd64e11a7e42cc5184a219e">tempest-ServerActionsTestOtherA-1600580756-project-member</nova:user>
Aug 26 20:47:55 user nova-compute[73476]:         <nova:project uuid="b16d8f644f0442fea1f8a57961111a30">tempest-ServerActionsTestOtherA-1600580756</nova:project>
Aug 26 20:47:55 user nova-compute[73476]:       </nova:owner>
Aug 26 20:47:55 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:47:55 user nova-compute[73476]:       <nova:ports>
Aug 26 20:47:55 user nova-compute[73476]:         <nova:port uuid="920e6ff4-145c-41b3-b513-49437e60144b">
Aug 26 20:47:55 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 20:47:55 user nova-compute[73476]:         </nova:port>
Aug 26 20:47:55 user nova-compute[73476]:       </nova:ports>
Aug 26 20:47:55 user nova-compute[73476]:     </nova:instance>
Aug 26 20:47:55 user nova-compute[73476]:   </metadata>
Aug 26 20:47:55 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:47:55 user nova-compute[73476]:     <system>
Aug 26 20:47:55 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:47:55 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:47:55 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:47:55 user nova-compute[73476]:       <entry name="serial">eaf9f058-2194-4e0e-9460-328108758c42</entry>
Aug 26 20:47:55 user nova-compute[73476]:       <entry name="uuid">eaf9f058-2194-4e0e-9460-328108758c42</entry>
Aug 26 20:47:55 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:47:55 user nova-compute[73476]:     </system>
Aug 26 20:47:55 user nova-compute[73476]:   </sysinfo>
Aug 26 20:47:55 user nova-compute[73476]:   <os>
Aug 26 20:47:55 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:47:55 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:47:55 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:47:55 user nova-compute[73476]:   </os>
Aug 26 20:47:55 user nova-compute[73476]:   <features>
Aug 26 20:47:55 user nova-compute[73476]:     <acpi/>
Aug 26 20:47:55 user nova-compute[73476]:     <apic/>
Aug 26 20:47:55 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:47:55 user nova-compute[73476]:   </features>
Aug 26 20:47:55 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:47:55 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:47:55 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:47:55 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:47:55 user nova-compute[73476]:   </clock>
Aug 26 20:47:55 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:47:55 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:47:55 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:47:55 user nova-compute[73476]:   </cpu>
Aug 26 20:47:55 user nova-compute[73476]:   <devices>
Aug 26 20:47:55 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:47:55 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:47:55 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk"/>
Aug 26 20:47:55 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:47:55 user nova-compute[73476]:     </disk>
Aug 26 20:47:55 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:47:55 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:47:55 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 20:47:55 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:47:55 user nova-compute[73476]:       <serial>241e27f5-1d23-4802-9866-3f66f16c0fbc</serial>
Aug 26 20:47:55 user nova-compute[73476]:     </disk>
Aug 26 20:47:55 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:47:55 user nova-compute[73476]:       <mac address="fa:16:3e:1c:de:05"/>
Aug 26 20:47:55 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:47:55 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:47:55 user nova-compute[73476]:       <target dev="tap920e6ff4-14"/>
Aug 26 20:47:55 user nova-compute[73476]:     </interface>
Aug 26 20:47:55 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:47:55 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/console.log" append="off"/>
Aug 26 20:47:55 user nova-compute[73476]:     </serial>
Aug 26 20:47:55 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:47:55 user nova-compute[73476]:     <video>
Aug 26 20:47:55 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:47:55 user nova-compute[73476]:     </video>
Aug 26 20:47:55 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:47:55 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:47:55 user nova-compute[73476]:     </rng>
Aug 26 20:47:55 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:47:55 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:47:55 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:47:55 user nova-compute[73476]:     </memballoon>
Aug 26 20:47:55 user nova-compute[73476]:   </devices>
Aug 26 20:47:55 user nova-compute[73476]: </domain>
Aug 26 20:47:55 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-924396',display_name='tempest-ServerActionsTestOtherA-server-1638955500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-924396',id=14,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV/yd8kfxlaTWXrDZ3wbLsadxJe1f2WQOA3s+97nsG/XDorWSKUuwbAAV+UBcfNkZOqvbKg3jvF1sQHB2BfsglNHCVhOpK2aXH6Iq8Qok+VhT6HbE2h3S1fpQjHJ8cjDw==',key_name='tempest-keypair-710174093',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:45:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-qgortcq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=eaf9f058-2194-4e0e-9460-328108758c42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_vif [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc5a665-3095-474a-93f0-b04672a7fef4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2] added
Aug 26 20:47:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap920e6ff4-14, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap920e6ff4-14, col_values=(('external_ids', {'iface-id': '920e6ff4-145c-41b3-b513-49437e60144b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:de:05', 'vm-uuid': 'eaf9f058-2194-4e0e-9460-328108758c42'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:55 user nova-compute[73476]: INFO os_vif [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14')
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0033a48-cb16-49bc-86f8-c955b56fd5ad]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30458ff-c404-49aa-8851-5300b8cf51d1]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDcINFvz {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDcINFvz" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab8857-e044-448e-9ffa-d915e61d0929]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uDcINFvz'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No VIF found with MAC fa:16:3e:1c:de:05, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d9a325-cf04-43b6-93ce-c2cdf956592b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c26cdac-de6f-4a05-aa87-9b62e3e0a6dc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:55 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:55 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5dbf84-65ed-4f38-922b-0d67c81ea260]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]
Aug 26 20:47:55 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.
Aug 26 20:47:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[319b2444-1c3c-4b70-9a8a-fe98bb6ff879]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e2ab80-58a3-4a21-b209-922c71da10f5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:55 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:55 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:47:55 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:47:55 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:47:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.045s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f07776-6927-42dc-ab95-3638051752a1]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:47:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] <== connect_volume: return (1733ms) {'type': 'block', 'scsi_wwn': '23838373138666163', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838373138666163', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-263678955',display_name='tempest-ServerActionsTestOtherB-server-263678955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-263678955',id=5,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6duovOgpoS/+TE0EH/fCNy+ilV5kxrulfvMaTJVTAkoOJVt3B0olv0pH7NT01fhQF+CMU3wUX3bGKgX/wKj8M/GNeOdqt2EwZ91VfdEmDAANieG8njlOp1SAEmAi7Ug==',key_name='tempest-keypair-1212818177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76a9f74cd94849f7a132c168b1ed5622',ramdisk_id='',reservation_id='r-ns6go6pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-42689020',owner_user_name='tempest-ServerActionsTestOtherB-42689020-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:47:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18713e0a843f45f08cdb8d70e7cafeeb',uuid=ad42cf47-42fb-488f-a44f-cf9824dd4d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converting VIF {"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:47:56 user nova-compute[73476]:   <uuid>ad42cf47-42fb-488f-a44f-cf9824dd4d99</uuid>
Aug 26 20:47:56 user nova-compute[73476]:   <name>instance-00000005</name>
Aug 26 20:47:56 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:47:56 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:47:56 user nova-compute[73476]:   <metadata>
Aug 26 20:47:56 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:47:56 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:47:56 user nova-compute[73476]:       <nova:name>tempest-ServerActionsTestOtherB-server-263678955</nova:name>
Aug 26 20:47:56 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:47:54</nova:creationTime>
Aug 26 20:47:56 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:47:56 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:47:56 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:47:56 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:47:56 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:47:56 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:47:56 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:47:56 user nova-compute[73476]:       <nova:owner>
Aug 26 20:47:56 user nova-compute[73476]:         <nova:user uuid="18713e0a843f45f08cdb8d70e7cafeeb">tempest-ServerActionsTestOtherB-42689020-project-member</nova:user>
Aug 26 20:47:56 user nova-compute[73476]:         <nova:project uuid="76a9f74cd94849f7a132c168b1ed5622">tempest-ServerActionsTestOtherB-42689020</nova:project>
Aug 26 20:47:56 user nova-compute[73476]:       </nova:owner>
Aug 26 20:47:56 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:47:56 user nova-compute[73476]:       <nova:ports>
Aug 26 20:47:56 user nova-compute[73476]:         <nova:port uuid="f0b59e8a-1964-4699-81f4-6a9c3b08dae0">
Aug 26 20:47:56 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 20:47:56 user nova-compute[73476]:         </nova:port>
Aug 26 20:47:56 user nova-compute[73476]:       </nova:ports>
Aug 26 20:47:56 user nova-compute[73476]:     </nova:instance>
Aug 26 20:47:56 user nova-compute[73476]:   </metadata>
Aug 26 20:47:56 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:47:56 user nova-compute[73476]:     <system>
Aug 26 20:47:56 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:47:56 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:47:56 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:47:56 user nova-compute[73476]:       <entry name="serial">ad42cf47-42fb-488f-a44f-cf9824dd4d99</entry>
Aug 26 20:47:56 user nova-compute[73476]:       <entry name="uuid">ad42cf47-42fb-488f-a44f-cf9824dd4d99</entry>
Aug 26 20:47:56 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:47:56 user nova-compute[73476]:     </system>
Aug 26 20:47:56 user nova-compute[73476]:   </sysinfo>
Aug 26 20:47:56 user nova-compute[73476]:   <os>
Aug 26 20:47:56 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:47:56 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:47:56 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:47:56 user nova-compute[73476]:   </os>
Aug 26 20:47:56 user nova-compute[73476]:   <features>
Aug 26 20:47:56 user nova-compute[73476]:     <acpi/>
Aug 26 20:47:56 user nova-compute[73476]:     <apic/>
Aug 26 20:47:56 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:47:56 user nova-compute[73476]:   </features>
Aug 26 20:47:56 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:47:56 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:47:56 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:47:56 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:47:56 user nova-compute[73476]:   </clock>
Aug 26 20:47:56 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:47:56 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:47:56 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:47:56 user nova-compute[73476]:   </cpu>
Aug 26 20:47:56 user nova-compute[73476]:   <devices>
Aug 26 20:47:56 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:47:56 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:47:56 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk"/>
Aug 26 20:47:56 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:47:56 user nova-compute[73476]:     </disk>
Aug 26 20:47:56 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:47:56 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:47:56 user nova-compute[73476]:       <source dev="/dev/sdc"/>
Aug 26 20:47:56 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:47:56 user nova-compute[73476]:       <serial>8809a5b6-d0f3-4f59-b94e-220073f5f4c2</serial>
Aug 26 20:47:56 user nova-compute[73476]:     </disk>
Aug 26 20:47:56 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:47:56 user nova-compute[73476]:       <mac address="fa:16:3e:65:28:58"/>
Aug 26 20:47:56 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:47:56 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:47:56 user nova-compute[73476]:       <target dev="tapf0b59e8a-19"/>
Aug 26 20:47:56 user nova-compute[73476]:     </interface>
Aug 26 20:47:56 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:47:56 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/console.log" append="off"/>
Aug 26 20:47:56 user nova-compute[73476]:     </serial>
Aug 26 20:47:56 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:47:56 user nova-compute[73476]:     <video>
Aug 26 20:47:56 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:47:56 user nova-compute[73476]:     </video>
Aug 26 20:47:56 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:47:56 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:47:56 user nova-compute[73476]:     </rng>
Aug 26 20:47:56 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:47:56 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:47:56 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:47:56 user nova-compute[73476]:     </memballoon>
Aug 26 20:47:56 user nova-compute[73476]:   </devices>
Aug 26 20:47:56 user nova-compute[73476]: </domain>
Aug 26 20:47:56 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-263678955',display_name='tempest-ServerActionsTestOtherB-server-263678955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-263678955',id=5,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6duovOgpoS/+TE0EH/fCNy+ilV5kxrulfvMaTJVTAkoOJVt3B0olv0pH7NT01fhQF+CMU3wUX3bGKgX/wKj8M/GNeOdqt2EwZ91VfdEmDAANieG8njlOp1SAEmAi7Ug==',key_name='tempest-keypair-1212818177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='76a9f74cd94849f7a132c168b1ed5622',ramdisk_id='',reservation_id='r-ns6go6pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-42689020',owner_user_name='tempest-ServerActionsTestOtherB-42689020-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:47:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18713e0a843f45f08cdb8d70e7cafeeb',uuid=ad42cf47-42fb-488f-a44f-cf9824dd4d99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converting VIF {"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG os_vif [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0b59e8a-19, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0b59e8a-19, col_values=(('external_ids', {'iface-id': 'f0b59e8a-1964-4699-81f4-6a9c3b08dae0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:28:58', 'vm-uuid': 'ad42cf47-42fb-488f-a44f-cf9824dd4d99'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:56 user nova-compute[73476]: INFO os_vif [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19')
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-943116bd-325a-4377-a80d-64a23d282731 req-0848b024-dedf-4522-a06a-ff46fee6326c service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-943116bd-325a-4377-a80d-64a23d282731 req-0848b024-dedf-4522-a06a-ff46fee6326c service nova] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-943116bd-325a-4377-a80d-64a23d282731 req-0848b024-dedf-4522-a06a-ff46fee6326c service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-943116bd-325a-4377-a80d-64a23d282731 req-0848b024-dedf-4522-a06a-ff46fee6326c service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-943116bd-325a-4377-a80d-64a23d282731 req-0848b024-dedf-4522-a06a-ff46fee6326c service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] No waiting events found dispatching network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:57 user nova-compute[73476]: WARNING nova.compute.manager [req-943116bd-325a-4377-a80d-64a23d282731 req-0848b024-dedf-4522-a06a-ff46fee6326c service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received unexpected event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b for instance with vm_state active and task_state rebuild_spawning.
Aug 26 20:47:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] No waiting events found dispatching network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:59 user nova-compute[73476]: WARNING nova.compute.manager [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received unexpected event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b for instance with vm_state active and task_state rebuild_spawning.
Aug 26 20:47:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:47:59 user nova-compute[73476]: WARNING nova.compute.manager [req-bb9e9c86-c0e0-49bd-85f0-0d67bd55703c req-cb56e677-9676-427f-9760-51ac0b3e5853 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state resized and task_state resize_reverting.
Aug 26 20:47:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:47:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082880.2255507, eaf9f058-2194-4e0e-9460-328108758c42 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] VM Resumed (Lifecycle Event)
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Instance spawned successfully.
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082880.2298422, eaf9f058-2194-4e0e-9460-328108758c42 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] VM Started (Lifecycle Event)
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 20:48:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73476) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e59fd4e1-a7d8-4d43-bb86-54adf5a3bb45 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.109s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082880.8362527, ad42cf47-42fb-488f-a44f-cf9824dd4d99 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] VM Resumed (Lifecycle Event)
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance running successfully.
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] finish_revert_migration finished successfully. {{(pid=73476) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082880.8383129, ad42cf47-42fb-488f-a44f-cf9824dd4d99 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] VM Started (Lifecycle Event)
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 20:48:01 user nova-compute[73476]: INFO nova.compute.manager [None req-f751c13f-e742-4fae-b045-8d22ab76af56 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance to original state: 'active'
Aug 26 20:48:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-86b12b04-052a-496b-b08b-de3290dd108e req-7fa998f6-f353-4aed-a8d3-f1ee0a2cc6e3 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-86b12b04-052a-496b-b08b-de3290dd108e req-7fa998f6-f353-4aed-a8d3-f1ee0a2cc6e3 service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-86b12b04-052a-496b-b08b-de3290dd108e req-7fa998f6-f353-4aed-a8d3-f1ee0a2cc6e3 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-86b12b04-052a-496b-b08b-de3290dd108e req-7fa998f6-f353-4aed-a8d3-f1ee0a2cc6e3 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-86b12b04-052a-496b-b08b-de3290dd108e req-7fa998f6-f353-4aed-a8d3-f1ee0a2cc6e3 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:01 user nova-compute[73476]: WARNING nova.compute.manager [req-86b12b04-052a-496b-b08b-de3290dd108e req-7fa998f6-f353-4aed-a8d3-f1ee0a2cc6e3 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state active and task_state None.
Aug 26 20:48:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-6519e919-7a8d-434d-af4b-8e36bc0f1fb5 req-36a3dd21-417e-41b4-9851-81deeb238aaf service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received event network-changed-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-6519e919-7a8d-434d-af4b-8e36bc0f1fb5 req-36a3dd21-417e-41b4-9851-81deeb238aaf service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Refreshing instance network info cache due to event network-changed-478d7c28-392c-453d-81f0-e9775f156e9e. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6519e919-7a8d-434d-af4b-8e36bc0f1fb5 req-36a3dd21-417e-41b4-9851-81deeb238aaf service nova] Acquiring lock "refresh_cache-94cfdb65-fd3d-4c46-bc38-f47b55edddd9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6519e919-7a8d-434d-af4b-8e36bc0f1fb5 req-36a3dd21-417e-41b4-9851-81deeb238aaf service nova] Acquired lock "refresh_cache-94cfdb65-fd3d-4c46-bc38-f47b55edddd9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-6519e919-7a8d-434d-af4b-8e36bc0f1fb5 req-36a3dd21-417e-41b4-9851-81deeb238aaf service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Refreshing network info cache for port 478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:48:03 user nova-compute[73476]: INFO nova.compute.claims [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Claim successful on node user
Aug 26 20:48:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:04 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:48:04 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:48:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-6519e919-7a8d-434d-af4b-8e36bc0f1fb5 req-36a3dd21-417e-41b4-9851-81deeb238aaf service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Updated VIF entry in instance network info cache for port 478d7c28-392c-453d-81f0-e9775f156e9e. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:48:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-6519e919-7a8d-434d-af4b-8e36bc0f1fb5 req-36a3dd21-417e-41b4-9851-81deeb238aaf service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Updating instance_info_cache with network_info: [{"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6519e919-7a8d-434d-af4b-8e36bc0f1fb5 req-36a3dd21-417e-41b4-9851-81deeb238aaf service nova] Releasing lock "refresh_cache-94cfdb65-fd3d-4c46-bc38-f47b55edddd9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.893s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:48:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:48:04 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:48:04 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:48:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:48:04 user nova-compute[73476]: INFO nova.virt.block_device [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Booting with volume 60eef670-6c83-45f8-85af-dc163f4ed233 at /dev/vda
Aug 26 20:48:04 user nova-compute[73476]: DEBUG nova.policy [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89e2c5481c8d4a5a859f17b8af08626a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1adaa2e9f94156a674b7825b4c7b37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG os_brick.utils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f835b892-3853-48ad-8f42-150822f666d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[00706bdf-65a4-4daa-a06a-81ee26e4afb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7dd4dc-2715-4763-85a8-685b73385b7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[db72e17a-d439-4dc1-8abe-8c2457aefd85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:05 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:48:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0b47ae-d294-4b7d-8e28-8f6aa423aad3]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG os_brick.utils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:05 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Updating existing volume attachment record: 0bb57759-7d78-4527-a95b-2f6091f449f5 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:48:06 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Successfully created port: c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:48:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:07 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Successfully updated port: c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:48:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "refresh_cache-ba24bae1-d608-41dd-b928-fad3ba415cc1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquired lock "refresh_cache-ba24bae1-d608-41dd-b928-fad3ba415cc1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:07 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:48:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-2d7cc7f1-9de9-412e-85ef-e8f359a57083 req-768df805-93df-4334-a063-f2e5cb29e4a8 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-changed-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-2d7cc7f1-9de9-412e-85ef-e8f359a57083 req-768df805-93df-4334-a063-f2e5cb29e4a8 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Refreshing instance network info cache due to event network-changed-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2d7cc7f1-9de9-412e-85ef-e8f359a57083 req-768df805-93df-4334-a063-f2e5cb29e4a8 service nova] Acquiring lock "refresh_cache-ba24bae1-d608-41dd-b928-fad3ba415cc1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:08 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:48:08 user nova-compute[73476]: INFO nova.compute.manager [None req-cb3cc1c5-3e34-4fba-9326-875bff0d6269 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Unrescuing
Aug 26 20:48:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3cc1c5-3e34-4fba-9326-875bff0d6269 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3cc1c5-3e34-4fba-9326-875bff0d6269 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquired lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:08 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb3cc1c5-3e34-4fba-9326-875bff0d6269 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:48:08 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Updating instance_info_cache with network_info: [{"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Releasing lock "refresh_cache-ba24bae1-d608-41dd-b928-fad3ba415cc1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance network_info: |[{"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:48:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2d7cc7f1-9de9-412e-85ef-e8f359a57083 req-768df805-93df-4334-a063-f2e5cb29e4a8 service nova] Acquired lock "refresh_cache-ba24bae1-d608-41dd-b928-fad3ba415cc1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:08 user nova-compute[73476]: DEBUG nova.network.neutron [req-2d7cc7f1-9de9-412e-85ef-e8f359a57083 req-768df805-93df-4334-a063-f2e5cb29e4a8 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Refreshing network info cache for port c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb3cc1c5-3e34-4fba-9326-875bff0d6269 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updating instance_info_cache with network_info: [{"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3cc1c5-3e34-4fba-9326-875bff0d6269 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Releasing lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cb3cc1c5-3e34-4fba-9326-875bff0d6269 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'flavor' on Instance uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG nova.network.neutron [req-2d7cc7f1-9de9-412e-85ef-e8f359a57083 req-768df805-93df-4334-a063-f2e5cb29e4a8 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Updated VIF entry in instance network info cache for port c9c5fd68-f9ac-4e5b-882d-8dcc870fc942. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG nova.network.neutron [req-2d7cc7f1-9de9-412e-85ef-e8f359a57083 req-768df805-93df-4334-a063-f2e5cb29e4a8 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Updating instance_info_cache with network_info: [{"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2d7cc7f1-9de9-412e-85ef-e8f359a57083 req-768df805-93df-4334-a063-f2e5cb29e4a8 service nova] Releasing lock "refresh_cache-ba24bae1-d608-41dd-b928-fad3ba415cc1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMloprsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:09 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:48:09 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:48:09 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6143420-de77-4277-996b-f48fdf6ce1e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:48:09 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c30c8fc-5f2c-4272-ab0d-bbb4f9f4d3e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc] added
Aug 26 20:48:09 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:09 user nova-compute[73476]: INFO nova.compute.manager [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Terminating instance
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aaa809-01ea-4108-9238-ce41656cb804]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b495835-b91a-4e66-8eac-05d1f6e5c2d0]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMloprsc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMloprsc" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed32543-b87a-489a-a942-a26fa4d44d61]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMloprsc'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.054s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e3793e-a142-42cd-9acb-eae2f5edf66f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-afa1bcc2-5d89-4777-b0ac-7fdd4014578a req-e19ab98a-9863-4da1-bb81-fc44aaa265f0 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-afa1bcc2-5d89-4777-b0ac-7fdd4014578a req-e19ab98a-9863-4da1-bb81-fc44aaa265f0 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-afa1bcc2-5d89-4777-b0ac-7fdd4014578a req-e19ab98a-9863-4da1-bb81-fc44aaa265f0 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-afa1bcc2-5d89-4777-b0ac-7fdd4014578a req-e19ab98a-9863-4da1-bb81-fc44aaa265f0 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-afa1bcc2-5d89-4777-b0ac-7fdd4014578a req-e19ab98a-9863-4da1-bb81-fc44aaa265f0 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:09 user nova-compute[73476]: WARNING nova.compute.manager [req-afa1bcc2-5d89-4777-b0ac-7fdd4014578a req-e19ab98a-9863-4da1-bb81-fc44aaa265f0 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be4169f-c5f8-4c2a-b0d3-405a19dadb65]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:09 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:09 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:09 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:09 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:09 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:09 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782b672-4754-4f8a-8e18-d4b80b7f6504]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260]
Aug 26 20:48:10 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260] successful.
Aug 26 20:48:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d24b4d-dec3-406b-8b26-5d1fd22e67eb]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e779e691-dc96-4510-a51d-bf5e6c18e069]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:10 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:10 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:10 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:10 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:10 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:10 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.460s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61737a9-3651-4bc7-ab80-f45f6bae3c3d]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-741117c4-6161-42d3-84a8-d84050a27e93 req-783f60ae-d2bf-4f5b-8a53-fcb818aef1c4 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-vif-unplugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-741117c4-6161-42d3-84a8-d84050a27e93 req-783f60ae-d2bf-4f5b-8a53-fcb818aef1c4 service nova] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-741117c4-6161-42d3-84a8-d84050a27e93 req-783f60ae-d2bf-4f5b-8a53-fcb818aef1c4 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-741117c4-6161-42d3-84a8-d84050a27e93 req-783f60ae-d2bf-4f5b-8a53-fcb818aef1c4 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-741117c4-6161-42d3-84a8-d84050a27e93 req-783f60ae-d2bf-4f5b-8a53-fcb818aef1c4 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] No waiting events found dispatching network-vif-unplugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-741117c4-6161-42d3-84a8-d84050a27e93 req-783f60ae-d2bf-4f5b-8a53-fcb818aef1c4 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-vif-unplugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Instance destroyed successfully.
Aug 26 20:48:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Instance destroyed successfully.
Aug 26 20:48:10 user nova-compute[73476]: DEBUG nova.objects.instance [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lazy-loading 'resources' on Instance uuid 22c72de3-e06b-4aae-bed9-162101a43e6f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1272776851',display_name='tempest-VolumesAdminNegativeTest-server-1272776851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1272776851',id=7,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPd6S7mvw3TVXiOJ1xSq8JXRA05KgKlnD6kKubB6f+v8PlZc2rmU/hXdW8ntPBsNU7gSNc20+3JGqxYrI+O0kcs07XlKsU5IVPczin/QAeIUMTFwCzWo1i1ppjsPKrfxw==',key_name='tempest-keypair-182732187',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0b92247b70b4ef6ab0d4bbb6a8a60f0',ramdisk_id='',reservation_id='r-ey2pn8ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1926983424',owner_user_name='tempest-VolumesAdminNegativeTest-1926983424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2bee4738d4442fabd6c6a802070555',uuid=22c72de3-e06b-4aae-bed9-162101a43e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converting VIF {"id": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "address": "fa:16:3e:19:7f:fd", "network": {"id": "5f830da0-cf5b-4a88-a676-4a8995845677", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1669159625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0b92247b70b4ef6ab0d4bbb6a8a60f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5378ea4f-5e", "ovs_interfaceid": "5378ea4f-5e56-4d66-a742-9b132fbc6160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:7f:fd,bridge_name='br-int',has_traffic_filtering=True,id=5378ea4f-5e56-4d66-a742-9b132fbc6160,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5378ea4f-5e') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG os_vif [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:7f:fd,bridge_name='br-int',has_traffic_filtering=True,id=5378ea4f-5e56-4d66-a742-9b132fbc6160,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5378ea4f-5e') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5378ea4f-5e, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:10 user nova-compute[73476]: INFO os_vif [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:7f:fd,bridge_name='br-int',has_traffic_filtering=True,id=5378ea4f-5e56-4d66-a742-9b132fbc6160,network=Network(5f830da0-cf5b-4a88-a676-4a8995845677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5378ea4f-5e')
Aug 26 20:48:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Deleting instance files /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f_del
Aug 26 20:48:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Deletion of /opt/stack/data/nova/instances/22c72de3-e06b-4aae-bed9-162101a43e6f_del complete
Aug 26 20:48:10 user nova-compute[73476]: INFO nova.compute.manager [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 26 20:48:10 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:48:10 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMloprsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '23531373262353739', 'path': '/dev/sdd'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531373262353739', 'path': '/dev/sdd'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG nova.objects.instance [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'flavor' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:48:11 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:48:11 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 20:48:11 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:48:11 user nova-compute[73476]:   <serial>971018e8-7d57-466a-a4cf-51465d1beabc</serial>
Aug 26 20:48:11 user nova-compute[73476]: </disk>
Aug 26 20:48:11 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lazy-loading 'flavor' on Instance uuid 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.157s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:11 user nova-compute[73476]: INFO nova.compute.manager [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Attaching volume c7e54bcb-5caa-4942-8d30-549dc6bd1311 to /dev/vdb
Aug 26 20:48:11 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:11 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Took 1.06 seconds to deallocate network for instance.
Aug 26 20:48:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-26acb30e-0744-48c5-9ffa-5322af17b2f9 req-c025b061-1520-440d-8724-5a6feb1ef1ff service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-vif-deleted-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG os_brick.utils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c5c34-7980-4ccc-8414-2aeaad280c92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.037s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[02185f46-7aad-4c38-bdc9-d7f05e310f6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No VIF found with MAC fa:16:3e:1b:25:fc, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[933e40b7-900d-4d87-b61e-d2157afdf738]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8742dc8e-b9d5-47bd-ba3b-37c0d9ded90d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:12 user nova-compute[73476]: WARNING nova.compute.manager [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:12 user nova-compute[73476]: WARNING nova.compute.manager [req-7c031ae0-82fa-45e0-b7a1-995ce525b738 req-88b8b0fd-c0fa-45b4-9a0f-7ea6be45e511 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:12 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e61e19e-fb35-42f3-bc9e-bf6198ce765e]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG os_brick.utils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] <== get_connector_properties: return (237ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Updating existing volume attachment record: a8e3571c-4b8a-4f50-ba38-2f6930ec562d {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-46d6241f-0a32-4813-9d1b-9e2c6d54fc81 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.682s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] No waiting events found dispatching network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:12 user nova-compute[73476]: WARNING nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received unexpected event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 for instance with vm_state deleted and task_state None.
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] No waiting events found dispatching network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:12 user nova-compute[73476]: WARNING nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received unexpected event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 for instance with vm_state deleted and task_state None.
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] No waiting events found dispatching network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:12 user nova-compute[73476]: WARNING nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received unexpected event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 for instance with vm_state deleted and task_state None.
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Acquiring lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] No waiting events found dispatching network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:12 user nova-compute[73476]: WARNING nova.compute.manager [req-4d55b40e-4661-4c2c-952e-7bb7acd9ec51 req-75a07000-797e-4583-adb5-c1988ce89a30 service nova] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Received unexpected event network-vif-plugged-5378ea4f-5e56-4d66-a742-9b132fbc6160 for instance with vm_state deleted and task_state None.
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:48:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.837s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:12 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Deleted allocations for instance 22c72de3-e06b-4aae-bed9-162101a43e6f
Aug 26 20:48:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-36fffdbe-8c5c-4f07-bffc-87b7a7095fae tempest-VolumesAdminNegativeTest-1926983424 tempest-VolumesAdminNegativeTest-1926983424-project-member] Lock "22c72de3-e06b-4aae-bed9-162101a43e6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.351s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:14 user nova-compute[73476]: WARNING nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:14 user nova-compute[73476]: WARNING nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:14 user nova-compute[73476]: WARNING nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:14 user nova-compute[73476]: WARNING nova.compute.manager [req-f4cf14f9-e78d-4f5b-bd14-6c674b0477ea req-4b7797ee-ea85-408f-9043-dc03631a7069 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for c2b05cbc-2666-4c5c-9a5b-be01236a1229 due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082894.9353936, c2b05cbc-2666-4c5c-9a5b-be01236a1229 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:14 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] VM Resumed (Lifecycle Event)
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb3cc1c5-3e34-4fba-9326-875bff0d6269 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:15 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 20:48:15 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082894.9361415, c2b05cbc-2666-4c5c-9a5b-be01236a1229 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:15 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] VM Started (Lifecycle Event)
Aug 26 20:48:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:15 user nova-compute[73476]: INFO nova.compute.manager [None req-eed1ad22-b106-44c8-b1f3-d829df3a583a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Unrescuing
Aug 26 20:48:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-eed1ad22-b106-44c8-b1f3-d829df3a583a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-eed1ad22-b106-44c8-b1f3-d829df3a583a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquired lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:15 user nova-compute[73476]: DEBUG nova.network.neutron [None req-eed1ad22-b106-44c8-b1f3-d829df3a583a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:48:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:16 user nova-compute[73476]: WARNING nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 22b50300-8865-4854-b0c7-ed63ca60c85b {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 215be88c-8470-453f-b293-ce98148be308 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid ad42cf47-42fb-488f-a44f-cf9824dd4d99 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 13e8971f-2d6c-4f8e-b895-411db3554e74 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 820f7ca5-8bf5-494d-8dae-b0ee3431f156 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 669c98c1-efd4-4119-8ad1-6adc20eb210d {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid ba24bae1-d608-41dd-b928-fad3ba415cc1 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid eaf9f058-2194-4e0e-9460-328108758c42 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "22b50300-8865-4854-b0c7-ed63ca60c85b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: INFO nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "215be88c-8470-453f-b293-ce98148be308" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "215be88c-8470-453f-b293-ce98148be308" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "eaf9f058-2194-4e0e-9460-328108758c42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.network.neutron [None req-eed1ad22-b106-44c8-b1f3-d829df3a583a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updating instance_info_cache with network_info: [{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-eed1ad22-b106-44c8-b1f3-d829df3a583a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Releasing lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.objects.instance [None req-eed1ad22-b106-44c8-b1f3-d829df3a583a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'flavor' on Instance uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "215be88c-8470-453f-b293-ce98148be308" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.168s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.582s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.580s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "eaf9f058-2194-4e0e-9460-328108758c42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.574s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-f34b2dd1-25e7-4c38-bd49-442d0967d70f req-63bc1845-18a1-4847-8d2d-a55be9363d7e service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f34b2dd1-25e7-4c38-bd49-442d0967d70f req-63bc1845-18a1-4847-8d2d-a55be9363d7e service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f34b2dd1-25e7-4c38-bd49-442d0967d70f req-63bc1845-18a1-4847-8d2d-a55be9363d7e service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f34b2dd1-25e7-4c38-bd49-442d0967d70f req-63bc1845-18a1-4847-8d2d-a55be9363d7e service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-f34b2dd1-25e7-4c38-bd49-442d0967d70f req-63bc1845-18a1-4847-8d2d-a55be9363d7e service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:16 user nova-compute[73476]: WARNING nova.compute.manager [req-f34b2dd1-25e7-4c38-bd49-442d0967d70f req-63bc1845-18a1-4847-8d2d-a55be9363d7e service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state active and task_state None.
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-78b37157-60e2-430f-9f68-39194a4a3b30 req-b53239a6-b2bb-49fa-966e-9c91981cdd48 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-78b37157-60e2-430f-9f68-39194a4a3b30 req-b53239a6-b2bb-49fa-966e-9c91981cdd48 service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-78b37157-60e2-430f-9f68-39194a4a3b30 req-b53239a6-b2bb-49fa-966e-9c91981cdd48 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-78b37157-60e2-430f-9f68-39194a4a3b30 req-b53239a6-b2bb-49fa-966e-9c91981cdd48 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-78b37157-60e2-430f-9f68-39194a4a3b30 req-b53239a6-b2bb-49fa-966e-9c91981cdd48 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:16 user nova-compute[73476]: WARNING nova.compute.manager [req-78b37157-60e2-430f-9f68-39194a4a3b30 req-b53239a6-b2bb-49fa-966e-9c91981cdd48 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:17 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Instance destroyed successfully.
Aug 26 20:48:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:18 user nova-compute[73476]: DEBUG nova.compute.manager [req-c9cab06b-30fd-4ad3-92aa-0385a3ec9485 req-10d5967c-8260-4155-aad5-9c8fe0db17f1 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c9cab06b-30fd-4ad3-92aa-0385a3ec9485 req-10d5967c-8260-4155-aad5-9c8fe0db17f1 service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c9cab06b-30fd-4ad3-92aa-0385a3ec9485 req-10d5967c-8260-4155-aad5-9c8fe0db17f1 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c9cab06b-30fd-4ad3-92aa-0385a3ec9485 req-10d5967c-8260-4155-aad5-9c8fe0db17f1 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:18 user nova-compute[73476]: DEBUG nova.compute.manager [req-c9cab06b-30fd-4ad3-92aa-0385a3ec9485 req-10d5967c-8260-4155-aad5-9c8fe0db17f1 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:18 user nova-compute[73476]: WARNING nova.compute.manager [req-c9cab06b-30fd-4ad3-92aa-0385a3ec9485 req-10d5967c-8260-4155-aad5-9c8fe0db17f1 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:20 user nova-compute[73476]: WARNING nova.compute.manager [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:20 user nova-compute[73476]: WARNING nova.compute.manager [req-a1ad73b5-81d8-43b2-9219-23802085a4fc req-c2352204-7ff6-4517-ac93-f10ed29a99d5 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:48:20 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Creating image(s)
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Ensure instance console log exists: /opt/stack/data/nova/instances/ba24bae1-d608-41dd-b928-fad3ba415cc1/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Start _get_guest_xml network_info=[{"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '0bb57759-7d78-4527-a95b-2f6091f449f5', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDqHkzZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba24bae1-d608-41dd-b928-fad3ba415cc1', 'attached_at': '', 'detached_at': '', 'volume_id': '60eef670-6c83-45f8-85af-dc163f4ed233', 'serial': '60eef670-6c83-45f8-85af-dc163f4ed233'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:48:20 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:48:20 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:48:20 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDqHkzZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:21 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:48:21 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:48:21 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for 531953d6-502b-4f11-8a53-0bf267bec1f0 due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082901.0357523, 531953d6-502b-4f11-8a53-0bf267bec1f0 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] VM Resumed (Lifecycle Event)
Aug 26 20:48:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-eed1ad22-b106-44c8-b1f3-d829df3a583a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5328e01-5fda-45af-9ea1-8ab78b7ad357]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:48:21 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[04916555-e90b-4170-8fb6-4472e8bc22b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233] added
Aug 26 20:48:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff94307-3f84-48a0-8a25-f4ad86204ac7]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 20:48:21 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082901.0405016, 531953d6-502b-4f11-8a53-0bf267bec1f0 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] VM Started (Lifecycle Event)
Aug 26 20:48:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.103s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb904e88-96b4-4900-a219-10e7e24833e0]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDqHkzZf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDqHkzZf" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb05894-cc8e-40dc-9741-e589676c3faa]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WDqHkzZf'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee5e2f6-6145-4b11-bd25-833925bc9d6b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7f61c-7d43-4227-a010-e5276cfa428a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[221b8774-3d6b-4047-b2c7-89a8fdf9bfc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260]
Aug 26 20:48:21 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260] successful.
Aug 26 20:48:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f903677b-7c4e-402c-b9aa-b63a1719857a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c0a966-fe22-4daa-8f8c-3ccbb409e5e5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:21 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.449s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c1a88a-f8fa-4ead-9223-d3edcf75086f]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:48:22 user nova-compute[73476]: INFO nova.compute.claims [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Claim successful on node user
Aug 26 20:48:22 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDqHkzZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '26462373935303432', 'path': '/dev/sde'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462373935303432', 'path': '/dev/sde'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1530961728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530961728',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwjoJwGNxGs7G8sGWzXNWPaMUrsR51iAkmlUCNqWZds597i69ly8h77pfkK/8WuXPB5E/6x9PUenKX8xpliIZdz/cCEW9R/w6nPEeKQAuV2ko7KXmy5CGuAoPNDGkI3Tg==',key_name='tempest-keypair-999954189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f1adaa2e9f94156a674b7825b4c7b37',ramdisk_id='',reservation_id='r-mlfz9lcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1323308358',owner_user_name='tempest-ServerActionsV293TestJSON-1323308358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89e2c5481c8d4a5a859f17b8af08626a',uuid=ba24bae1-d608-41dd-b928-fad3ba415cc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converting VIF {"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.objects.instance [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lazy-loading 'pci_devices' on Instance uuid ba24bae1-d608-41dd-b928-fad3ba415cc1 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:48:22 user nova-compute[73476]:   <uuid>ba24bae1-d608-41dd-b928-fad3ba415cc1</uuid>
Aug 26 20:48:22 user nova-compute[73476]:   <name>instance-00000013</name>
Aug 26 20:48:22 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:48:22 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:48:22 user nova-compute[73476]:   <metadata>
Aug 26 20:48:22 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:48:22 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:48:22 user nova-compute[73476]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1530961728</nova:name>
Aug 26 20:48:22 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:48:20</nova:creationTime>
Aug 26 20:48:22 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:48:22 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:48:22 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:48:22 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:48:22 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:48:22 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:48:22 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:48:22 user nova-compute[73476]:       <nova:owner>
Aug 26 20:48:22 user nova-compute[73476]:         <nova:user uuid="89e2c5481c8d4a5a859f17b8af08626a">tempest-ServerActionsV293TestJSON-1323308358-project-member</nova:user>
Aug 26 20:48:22 user nova-compute[73476]:         <nova:project uuid="2f1adaa2e9f94156a674b7825b4c7b37">tempest-ServerActionsV293TestJSON-1323308358</nova:project>
Aug 26 20:48:22 user nova-compute[73476]:       </nova:owner>
Aug 26 20:48:22 user nova-compute[73476]:       <nova:ports>
Aug 26 20:48:22 user nova-compute[73476]:         <nova:port uuid="c9c5fd68-f9ac-4e5b-882d-8dcc870fc942">
Aug 26 20:48:22 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 20:48:22 user nova-compute[73476]:         </nova:port>
Aug 26 20:48:22 user nova-compute[73476]:       </nova:ports>
Aug 26 20:48:22 user nova-compute[73476]:     </nova:instance>
Aug 26 20:48:22 user nova-compute[73476]:   </metadata>
Aug 26 20:48:22 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:48:22 user nova-compute[73476]:     <system>
Aug 26 20:48:22 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:48:22 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:48:22 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:48:22 user nova-compute[73476]:       <entry name="serial">ba24bae1-d608-41dd-b928-fad3ba415cc1</entry>
Aug 26 20:48:22 user nova-compute[73476]:       <entry name="uuid">ba24bae1-d608-41dd-b928-fad3ba415cc1</entry>
Aug 26 20:48:22 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:48:22 user nova-compute[73476]:     </system>
Aug 26 20:48:22 user nova-compute[73476]:   </sysinfo>
Aug 26 20:48:22 user nova-compute[73476]:   <os>
Aug 26 20:48:22 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:48:22 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:48:22 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:48:22 user nova-compute[73476]:   </os>
Aug 26 20:48:22 user nova-compute[73476]:   <features>
Aug 26 20:48:22 user nova-compute[73476]:     <acpi/>
Aug 26 20:48:22 user nova-compute[73476]:     <apic/>
Aug 26 20:48:22 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:48:22 user nova-compute[73476]:   </features>
Aug 26 20:48:22 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:48:22 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:48:22 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:48:22 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:48:22 user nova-compute[73476]:   </clock>
Aug 26 20:48:22 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:48:22 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:48:22 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:48:22 user nova-compute[73476]:   </cpu>
Aug 26 20:48:22 user nova-compute[73476]:   <devices>
Aug 26 20:48:22 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:48:22 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:48:22 user nova-compute[73476]:       <source dev="/dev/sde"/>
Aug 26 20:48:22 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:48:22 user nova-compute[73476]:       <serial>60eef670-6c83-45f8-85af-dc163f4ed233</serial>
Aug 26 20:48:22 user nova-compute[73476]:     </disk>
Aug 26 20:48:22 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:48:22 user nova-compute[73476]:       <mac address="fa:16:3e:7f:65:fd"/>
Aug 26 20:48:22 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:48:22 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:48:22 user nova-compute[73476]:       <target dev="tapc9c5fd68-f9"/>
Aug 26 20:48:22 user nova-compute[73476]:     </interface>
Aug 26 20:48:22 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:48:22 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ba24bae1-d608-41dd-b928-fad3ba415cc1/console.log" append="off"/>
Aug 26 20:48:22 user nova-compute[73476]:     </serial>
Aug 26 20:48:22 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:48:22 user nova-compute[73476]:     <video>
Aug 26 20:48:22 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:48:22 user nova-compute[73476]:     </video>
Aug 26 20:48:22 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:48:22 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:48:22 user nova-compute[73476]:     </rng>
Aug 26 20:48:22 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:48:22 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:48:22 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:48:22 user nova-compute[73476]:     </memballoon>
Aug 26 20:48:22 user nova-compute[73476]:   </devices>
Aug 26 20:48:22 user nova-compute[73476]: </domain>
Aug 26 20:48:22 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1530961728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530961728',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwjoJwGNxGs7G8sGWzXNWPaMUrsR51iAkmlUCNqWZds597i69ly8h77pfkK/8WuXPB5E/6x9PUenKX8xpliIZdz/cCEW9R/w6nPEeKQAuV2ko7KXmy5CGuAoPNDGkI3Tg==',key_name='tempest-keypair-999954189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f1adaa2e9f94156a674b7825b4c7b37',ramdisk_id='',reservation_id='r-mlfz9lcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1323308358',owner_user_name='tempest-ServerActionsV293TestJSON-1323308358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89e2c5481c8d4a5a859f17b8af08626a',uuid=ba24bae1-d608-41dd-b928-fad3ba415cc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converting VIF {"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG os_vif [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9c5fd68-f9, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9c5fd68-f9, col_values=(('external_ids', {'iface-id': 'c9c5fd68-f9ac-4e5b-882d-8dcc870fc942', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:65:fd', 'vm-uuid': 'ba24bae1-d608-41dd-b928-fad3ba415cc1'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:22 user nova-compute[73476]: INFO os_vif [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9')
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:48:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] No VIF found with MAC fa:16:3e:7f:65:fd, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:48:23 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:48:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:48:23 user nova-compute[73476]: INFO nova.virt.block_device [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Booting with volume 63c1d1b3-ffad-4325-aaef-fe223054c8f0 at /dev/vda
Aug 26 20:48:23 user nova-compute[73476]: DEBUG nova.policy [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4af3744acebb45cc912456b064371c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1411d212654847d688386973f7b6de8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG os_brick.utils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac6b538-9be9-4660-aec2-bfac5935c617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a2a941-8827-4da0-95ea-4d18205c9d39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5d5fc4-2b1f-4702-8923-51e2528e7f35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e65a5f-34e1-45b8-baae-8f058a32eed2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:23 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:48:23 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4cf435-1759-47a0-bc37-d92108bd46ae]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG os_brick.utils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:23 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating existing volume attachment record: 484812d5-4638-423d-bc83-2dd7981dd271 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully created port: e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-76d57f63-35a2-481c-8aca-f6fbce661786 req-87906880-959b-41ae-b745-37b4a95852fb service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-76d57f63-35a2-481c-8aca-f6fbce661786 req-87906880-959b-41ae-b745-37b4a95852fb service nova] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-76d57f63-35a2-481c-8aca-f6fbce661786 req-87906880-959b-41ae-b745-37b4a95852fb service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-76d57f63-35a2-481c-8aca-f6fbce661786 req-87906880-959b-41ae-b745-37b4a95852fb service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-76d57f63-35a2-481c-8aca-f6fbce661786 req-87906880-959b-41ae-b745-37b4a95852fb service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] No waiting events found dispatching network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:24 user nova-compute[73476]: WARNING nova.compute.manager [req-76d57f63-35a2-481c-8aca-f6fbce661786 req-87906880-959b-41ae-b745-37b4a95852fb service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received unexpected event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 for instance with vm_state building and task_state spawning.
Aug 26 20:48:24 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:25 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully created port: cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:48:25 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082890.6494591, 22c72de3-e06b-4aae-bed9-162101a43e6f => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:25 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] VM Stopped (Lifecycle Event)
Aug 26 20:48:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-18317697-bd80-44e6-88d0-4915891744f5 None None] [instance: 22c72de3-e06b-4aae-bed9-162101a43e6f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:26 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully created port: 93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:48:26 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-9e0b2613-f952-47cd-be0b-7dfcb29f6609 req-2b41c8e6-1d27-4250-b44a-717a3e1b3dab service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e0b2613-f952-47cd-be0b-7dfcb29f6609 req-2b41c8e6-1d27-4250-b44a-717a3e1b3dab service nova] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e0b2613-f952-47cd-be0b-7dfcb29f6609 req-2b41c8e6-1d27-4250-b44a-717a3e1b3dab service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9e0b2613-f952-47cd-be0b-7dfcb29f6609 req-2b41c8e6-1d27-4250-b44a-717a3e1b3dab service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-9e0b2613-f952-47cd-be0b-7dfcb29f6609 req-2b41c8e6-1d27-4250-b44a-717a3e1b3dab service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] No waiting events found dispatching network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:26 user nova-compute[73476]: WARNING nova.compute.manager [req-9e0b2613-f952-47cd-be0b-7dfcb29f6609 req-2b41c8e6-1d27-4250-b44a-717a3e1b3dab service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received unexpected event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 for instance with vm_state building and task_state spawning.
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTnmFKgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:27 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:48:27 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:48:27 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082907.0522625, ba24bae1-d608-41dd-b928-fad3ba415cc1 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:27 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] VM Resumed (Lifecycle Event)
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:48:27 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance spawned successfully.
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[72493fa8-3d57-4716-8645-b84a879402f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:48:27 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2fcff5-a59f-4a95-b14d-15176535d568]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311] added
Aug 26 20:48:27 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d45787-4d64-48d9-bb2f-9f39289eba4f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082907.0524297, ba24bae1-d608-41dd-b928-fad3ba415cc1 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:27 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] VM Started (Lifecycle Event)
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2bf17c-98db-4ff3-8cf9-fad3bc507168]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTnmFKgw {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTnmFKgw" returned: 0 in 0.094s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eb3e75-87b6-454f-a117-79553501c410]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WTnmFKgw'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.085s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[364af000-a884-456e-9978-d23c285658e3]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: INFO nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e4dc44-9496-48ed-9ebf-c24107f206da]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: INFO nova.compute.manager [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Took 23.75 seconds to build instance.
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --login" returned: 0 in 0.139s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[510cc43e-289c-4bec-a48d-d80bd601edfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b2b44846-f7b5-4cbd-8a5d-d3a2c4748f83 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.916s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311, portal: 172.16.0.220,3260]
Aug 26 20:48:27 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311, portal: 172.16.0.220,3260] successful.
Aug 26 20:48:27 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.405s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:27 user nova-compute[73476]: INFO nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ef113a-e18a-475a-b424-b921fa670619]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b744dd-0cd4-4d69-aa5a-b0f0bc4440c8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:48:27 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.602s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.038s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[73337bc9-6981-4f0b-883f-d28d343eac34]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTnmFKgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:48:27 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully created port: baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.667s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] <== connect_volume: return (1669ms) {'type': 'block', 'scsi_wwn': '23864346433386634', 'path': '/dev/sdf'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864346433386634', 'path': '/dev/sdf'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lazy-loading 'flavor' on Instance uuid 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:48:28 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:48:28 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:48:28 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:48:28 user nova-compute[73476]:   <serial>c7e54bcb-5caa-4942-8d30-549dc6bd1311</serial>
Aug 26 20:48:28 user nova-compute[73476]: </disk>
Aug 26 20:48:28 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully created port: 4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-b407d1eb-fc31-465e-a787-699569adcab7 req-9560f2ea-a3d0-4b85-972c-05ee292363fa service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-b407d1eb-fc31-465e-a787-699569adcab7 req-9560f2ea-a3d0-4b85-972c-05ee292363fa service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing instance network info cache due to event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b407d1eb-fc31-465e-a787-699569adcab7 req-9560f2ea-a3d0-4b85-972c-05ee292363fa service nova] Acquiring lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b407d1eb-fc31-465e-a787-699569adcab7 req-9560f2ea-a3d0-4b85-972c-05ee292363fa service nova] Acquired lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:28 user nova-compute[73476]: DEBUG nova.network.neutron [req-b407d1eb-fc31-465e-a787-699569adcab7 req-9560f2ea-a3d0-4b85-972c-05ee292363fa service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:48:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:48:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] No VIF found with MAC fa:16:3e:b2:74:9f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:48:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f42fcf23-669a-461b-87ca-c371203e29b5 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.434s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.236s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG nova.network.neutron [req-b407d1eb-fc31-465e-a787-699569adcab7 req-9560f2ea-a3d0-4b85-972c-05ee292363fa service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updated VIF entry in instance network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG nova.network.neutron [req-b407d1eb-fc31-465e-a787-699569adcab7 req-9560f2ea-a3d0-4b85-972c-05ee292363fa service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updating instance_info_cache with network_info: [{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b407d1eb-fc31-465e-a787-699569adcab7 req-9560f2ea-a3d0-4b85-972c-05ee292363fa service nova] Releasing lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully updated port: e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-683505b9-d51c-4a95-9910-c1fc909c1fc2 req-8889ba88-17f6-4a84-b167-34635fdfdefb service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-changed-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-683505b9-d51c-4a95-9910-c1fc909c1fc2 req-8889ba88-17f6-4a84-b167-34635fdfdefb service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing instance network info cache due to event network-changed-e7a2b1fb-8621-47fb-9630-01a6133a13b3. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-683505b9-d51c-4a95-9910-c1fc909c1fc2 req-8889ba88-17f6-4a84-b167-34635fdfdefb service nova] Acquiring lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-683505b9-d51c-4a95-9910-c1fc909c1fc2 req-8889ba88-17f6-4a84-b167-34635fdfdefb service nova] Acquired lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:30 user nova-compute[73476]: DEBUG nova.network.neutron [req-683505b9-d51c-4a95-9910-c1fc909c1fc2 req-8889ba88-17f6-4a84-b167-34635fdfdefb service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing network info cache for port e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:31 user nova-compute[73476]: DEBUG nova.network.neutron [req-683505b9-d51c-4a95-9910-c1fc909c1fc2 req-8889ba88-17f6-4a84-b167-34635fdfdefb service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:48:32 user nova-compute[73476]: DEBUG nova.network.neutron [req-683505b9-d51c-4a95-9910-c1fc909c1fc2 req-8889ba88-17f6-4a84-b167-34635fdfdefb service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-683505b9-d51c-4a95-9910-c1fc909c1fc2 req-8889ba88-17f6-4a84-b167-34635fdfdefb service nova] Releasing lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:32 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:32 user nova-compute[73476]: DEBUG nova.compute.manager [req-34c0e35e-ec90-4f9b-ab64-1cc5f3e2ddd4 req-4fc15e39-2fcd-4fd0-83ab-111b530e6433 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:32 user nova-compute[73476]: DEBUG nova.compute.manager [req-34c0e35e-ec90-4f9b-ab64-1cc5f3e2ddd4 req-4fc15e39-2fcd-4fd0-83ab-111b530e6433 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing instance network info cache due to event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-34c0e35e-ec90-4f9b-ab64-1cc5f3e2ddd4 req-4fc15e39-2fcd-4fd0-83ab-111b530e6433 service nova] Acquiring lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-34c0e35e-ec90-4f9b-ab64-1cc5f3e2ddd4 req-4fc15e39-2fcd-4fd0-83ab-111b530e6433 service nova] Acquired lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:32 user nova-compute[73476]: DEBUG nova.network.neutron [req-34c0e35e-ec90-4f9b-ab64-1cc5f3e2ddd4 req-4fc15e39-2fcd-4fd0-83ab-111b530e6433 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:33 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:33 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:33 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:48:33 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully updated port: c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:48:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG nova.network.neutron [req-34c0e35e-ec90-4f9b-ab64-1cc5f3e2ddd4 req-4fc15e39-2fcd-4fd0-83ab-111b530e6433 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updated VIF entry in instance network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG nova.network.neutron [req-34c0e35e-ec90-4f9b-ab64-1cc5f3e2ddd4 req-4fc15e39-2fcd-4fd0-83ab-111b530e6433 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updating instance_info_cache with network_info: [{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-34c0e35e-ec90-4f9b-ab64-1cc5f3e2ddd4 req-4fc15e39-2fcd-4fd0-83ab-111b530e6433 service nova] Releasing lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:34 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully updated port: 420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-changed-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing instance network info cache due to event network-changed-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] Acquiring lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] Acquired lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG nova.network.neutron [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing network info cache for port c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG nova.network.neutron [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG nova.network.neutron [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] Releasing lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-changed-420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing instance network info cache due to event network-changed-420a36c6-a0de-4cad-af7d-19aae1ea7571. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] Acquiring lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] Acquired lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG nova.network.neutron [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing network info cache for port 420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG nova.network.neutron [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG nova.network.neutron [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a7898d9d-7284-44fe-92aa-c9f79de6bb0d req-31d48610-c3f5-42e4-b890-2fbf22892b15 service nova] Releasing lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully updated port: cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-0de5f5dd-7bdd-42ef-ae8e-e96f45378295 req-ef810b22-e579-41af-afe4-5460e91555e8 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-changed-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-0de5f5dd-7bdd-42ef-ae8e-e96f45378295 req-ef810b22-e579-41af-afe4-5460e91555e8 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing instance network info cache due to event network-changed-cab225e4-c201-4e24-878b-34d0aedaa365. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0de5f5dd-7bdd-42ef-ae8e-e96f45378295 req-ef810b22-e579-41af-afe4-5460e91555e8 service nova] Acquiring lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0de5f5dd-7bdd-42ef-ae8e-e96f45378295 req-ef810b22-e579-41af-afe4-5460e91555e8 service nova] Acquired lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG nova.network.neutron [req-0de5f5dd-7bdd-42ef-ae8e-e96f45378295 req-ef810b22-e579-41af-afe4-5460e91555e8 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing network info cache for port cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG nova.network.neutron [req-0de5f5dd-7bdd-42ef-ae8e-e96f45378295 req-ef810b22-e579-41af-afe4-5460e91555e8 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully updated port: 93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG nova.network.neutron [req-0de5f5dd-7bdd-42ef-ae8e-e96f45378295 req-ef810b22-e579-41af-afe4-5460e91555e8 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0de5f5dd-7bdd-42ef-ae8e-e96f45378295 req-ef810b22-e579-41af-afe4-5460e91555e8 service nova] Releasing lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully updated port: baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-changed-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing instance network info cache due to event network-changed-93c27189-8f35-4144-a932-fb997648e90e. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] Acquiring lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] Acquired lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.network.neutron [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing network info cache for port 93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:48:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=7087MB free_disk=25.24654769897461GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:39 user nova-compute[73476]: INFO nova.virt.block_device [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Booting with volume 9febb691-5958-42d0-92ac-3cc5ad5ecdfa at /dev/vdb
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.network.neutron [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance eaf9f058-2194-4e0e-9460-328108758c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ad42cf47-42fb-488f-a44f-cf9824dd4d99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 669c98c1-efd4-4119-8ad1-6adc20eb210d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ba24bae1-d608-41dd-b928-fad3ba415cc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG os_brick.utils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[25de1adf-03c9-467b-9533-797cb3b56394]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6583644e-3da4-456a-b526-4381ccf1057e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4b10e0-01b0-4a37-89f9-3f5f6086db96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b8893b-3fe9-49a2-82f7-cfc3d3885b49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:39 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:48:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[543d1ddd-f206-47d6-b8b1-5f1bc2213481]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG os_brick.utils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:39 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating existing volume attachment record: d98478a3-06fc-4739-acb6-3c27521148df {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG nova.network.neutron [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] Releasing lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-changed-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing instance network info cache due to event network-changed-baeeff04-50ca-4ee8-b2f3-2437a3225a5a. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] Acquiring lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] Acquired lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG nova.network.neutron [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing network info cache for port baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:40 user nova-compute[73476]: DEBUG nova.network.neutron [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG nova.network.neutron [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7266f06f-009a-4d5b-917c-3c0564332a80 req-5cc1a012-e72d-4d2e-a2cf-d76776bf2d0d service nova] Releasing lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Successfully updated port: 4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquired lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-3856fe3a-c2e2-4a48-94bb-eec67edb35e1 req-0e48cc88-0796-4c1f-af11-1a5e2a229d82 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-changed-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-3856fe3a-c2e2-4a48-94bb-eec67edb35e1 req-0e48cc88-0796-4c1f-af11-1a5e2a229d82 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing instance network info cache due to event network-changed-4384aff6-53bf-419c-b73d-50ae3c9fa1b7. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3856fe3a-c2e2-4a48-94bb-eec67edb35e1 req-0e48cc88-0796-4c1f-af11-1a5e2a229d82 service nova] Acquiring lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-5c715121-a1e3-4368-94f1-55274d33b2f6 req-deecd8dd-543c-40a1-acb6-262c9b564a76 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received event network-changed-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-5c715121-a1e3-4368-94f1-55274d33b2f6 req-deecd8dd-543c-40a1-acb6-262c9b564a76 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Refreshing instance network info cache due to event network-changed-5cab1496-d1b3-4d92-858e-d193a55c29cc. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5c715121-a1e3-4368-94f1-55274d33b2f6 req-deecd8dd-543c-40a1-acb6-262c9b564a76 service nova] Acquiring lock "refresh_cache-820f7ca5-8bf5-494d-8dae-b0ee3431f156" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5c715121-a1e3-4368-94f1-55274d33b2f6 req-deecd8dd-543c-40a1-acb6-262c9b564a76 service nova] Acquired lock "refresh_cache-820f7ca5-8bf5-494d-8dae-b0ee3431f156" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:41 user nova-compute[73476]: DEBUG nova.network.neutron [req-5c715121-a1e3-4368-94f1-55274d33b2f6 req-deecd8dd-543c-40a1-acb6-262c9b564a76 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Refreshing network info cache for port 5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:48:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:48:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 20:48:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-5c715121-a1e3-4368-94f1-55274d33b2f6 req-deecd8dd-543c-40a1-acb6-262c9b564a76 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Updated VIF entry in instance network info cache for port 5cab1496-d1b3-4d92-858e-d193a55c29cc. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:48:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-5c715121-a1e3-4368-94f1-55274d33b2f6 req-deecd8dd-543c-40a1-acb6-262c9b564a76 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Updating instance_info_cache with network_info: [{"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5c715121-a1e3-4368-94f1-55274d33b2f6 req-deecd8dd-543c-40a1-acb6-262c9b564a76 service nova] Releasing lock "refresh_cache-820f7ca5-8bf5-494d-8dae-b0ee3431f156" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:43 user nova-compute[73476]: INFO nova.compute.manager [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Rebooting instance
Aug 26 20:48:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquired lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:43 user nova-compute[73476]: DEBUG nova.network.neutron [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:48:44 user nova-compute[73476]: DEBUG nova.network.neutron [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updating instance_info_cache with network_info: [{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Releasing lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:45 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Instance destroyed successfully.
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.objects.instance [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'resources' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-156038062',display_name='tempest-TestMinimumBasicScenario-server-156038062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-156038062',id=15,image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkJCbzXhqk2qkP5QbVoSQJsfJpi0quIEXOrN1Y/M8/7w5E0N6PnAbbhRBVuWJG+5R2Z7GtWVh0b63siP4vpOV4BZpC3h7aMxmwFg7L7UHYfBWP0Fi7o7fm8PbJV8DrNFw==',key_name='tempest-TestMinimumBasicScenario-802005258',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c0bf9d46b5447a495d0cf45071e0c27',ramdisk_id='',reservation_id='r-nljd6hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1097465264',owner_user_name='tempest-TestMinimumBasicScenario-1097465264-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:48:45Z,user_data=None,user_id='818cdd5f2ecf42739eb1d1d44c2d78e5',uuid=7f2e574f-a47c-45dc-9261-14de64d5ac7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converting VIF {"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_vif [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31732c2a-94, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:45 user nova-compute[73476]: INFO os_vif [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94')
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMloprsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[273f500b-3282-4255-8a84-9f812559f107]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[69796aff-7ee2-4b28-a6ad-8070d3ea7186]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:48:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:45 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:48:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25dd659900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc'): ({'sdd'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Removing single pathed devices sdd {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c75b661-e0f7-44bc-b0d1-3c5e2578e30a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7f5956-78c9-4c4a-a867-36f779422904]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Flushing IO for device /dev/sdd {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ed96d0-22be-4411-b0c8-028c4044a0e6]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-1797b042-b75b-44a0-8857-02aa60afc30e req-efb04e1c-dab9-4abb-9685-e59914222fc7 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-unplugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1797b042-b75b-44a0-8857-02aa60afc30e req-efb04e1c-dab9-4abb-9685-e59914222fc7 service nova] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1797b042-b75b-44a0-8857-02aa60afc30e req-efb04e1c-dab9-4abb-9685-e59914222fc7 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1797b042-b75b-44a0-8857-02aa60afc30e req-efb04e1c-dab9-4abb-9685-e59914222fc7 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-1797b042-b75b-44a0-8857-02aa60afc30e req-efb04e1c-dab9-4abb-9685-e59914222fc7 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] No waiting events found dispatching network-vif-unplugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:45 user nova-compute[73476]: WARNING nova.compute.manager [req-1797b042-b75b-44a0-8857-02aa60afc30e req-efb04e1c-dab9-4abb-9685-e59914222fc7 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received unexpected event network-vif-unplugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9bd2f0-d901-4732-a343-bacedb121ab4]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[936158ce-0176-48cc-9d8e-e0d03ea55e8b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e7a74-6609-4392-bd32-73dac61c7550]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260]
Aug 26 20:48:45 user nova-compute[73476]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260] successful.
Aug 26 20:48:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0773ab68-8294-4e37-ada3-bfa35a32de9f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] <== disconnect_volume: return (364ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Start _get_guest_xml network_info=[{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90f6bd11-46de-438c-b4ec-77bdac4447f7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '90f6bd11-46de-438c-b4ec-77bdac4447f7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'fe922b11-9726-4a7b-92a7-37025e54061c', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMloprsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '7f2e574f-a47c-45dc-9261-14de64d5ac7b', 'attached_at': '', 'detached_at': '', 'volume_id': '971018e8-7d57-466a-a4cf-51465d1beabc', 'serial': '971018e8-7d57-466a-a4cf-51465d1beabc'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:48:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:48:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90f6bd11-46de-438c-b4ec-77bdac4447f7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.objects.instance [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.objects.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Object Instance<7f2e574f-a47c-45dc-9261-14de64d5ac7b> lazy-loaded attributes: resources,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMloprsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:48:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:48:45 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac63b350-2dc4-4fb0-869b-c4d772956d3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:48:45 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75e74f8-c7c6-4cc8-8f53-03a6af2de22c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc] added
Aug 26 20:48:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [{"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9419711-3c1b-429f-8c84-e1ccf62c322c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac5e20-2213-41db-a177-5073b1353a80]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMloprsc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Releasing lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance network_info: |[{"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3856fe3a-c2e2-4a48-94bb-eec67edb35e1 req-0e48cc88-0796-4c1f-af11-1a5e2a229d82 service nova] Acquired lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-3856fe3a-c2e2-4a48-94bb-eec67edb35e1 req-0e48cc88-0796-4c1f-af11-1a5e2a229d82 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing network info cache for port 4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMloprsc" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dcc650-ca97-4e58-93a1-37c31df611df]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMloprsc'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce53291-81e7-40c8-9c94-6aca713a90cd]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7830d3-dd0e-4bb8-8aeb-ce7f5b7026c0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3059a8c1-0307-4c28-8c87-149816895409]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260]
Aug 26 20:48:46 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260] successful.
Aug 26 20:48:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce36472-1e2a-441e-9153-3a6fdcbf702b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c795036-255a-40d0-a5ee-08503aa1672b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:48:46 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:48:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec9fef4-3471-4f65-a6fa-830eb44f5da1]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMloprsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-3856fe3a-c2e2-4a48-94bb-eec67edb35e1 req-0e48cc88-0796-4c1f-af11-1a5e2a229d82 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updated VIF entry in instance network info cache for port 4384aff6-53bf-419c-b73d-50ae3c9fa1b7. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-3856fe3a-c2e2-4a48-94bb-eec67edb35e1 req-0e48cc88-0796-4c1f-af11-1a5e2a229d82 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [{"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3856fe3a-c2e2-4a48-94bb-eec67edb35e1 req-0e48cc88-0796-4c1f-af11-1a5e2a229d82 service nova] Releasing lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'flavor' on Instance uuid 820f7ca5-8bf5-494d-8dae-b0ee3431f156 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:47 user nova-compute[73476]: INFO nova.compute.manager [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Attaching volume e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 to /dev/vdb
Aug 26 20:48:47 user nova-compute[73476]: DEBUG os_brick.utils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfac479-5fea-4f31-9d4e-2e059cf8d604]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c89971-b906-4f98-a0b6-56a29ef8da90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffb66be-7342-4423-8d16-10107bce794e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad6ed6d-7f8c-4e47-826d-641683cc09da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:47 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6003b5-fd81-4cd8-9bd4-79ea99479b82]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG os_brick.utils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Updating existing volume attachment record: d9b7c267-b80a-4c85-90ee-25794899c6c1 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23531373262353739', 'path': '/dev/sdd'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531373262353739', 'path': '/dev/sdd'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-156038062',display_name='tempest-TestMinimumBasicScenario-server-156038062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-156038062',id=15,image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkJCbzXhqk2qkP5QbVoSQJsfJpi0quIEXOrN1Y/M8/7w5E0N6PnAbbhRBVuWJG+5R2Z7GtWVh0b63siP4vpOV4BZpC3h7aMxmwFg7L7UHYfBWP0Fi7o7fm8PbJV8DrNFw==',key_name='tempest-TestMinimumBasicScenario-802005258',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c0bf9d46b5447a495d0cf45071e0c27',ramdisk_id='',reservation_id='r-nljd6hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1097465264',owner_user_name='tempest-TestMinimumBasicScenario-1097465264-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:48:45Z,user_data=None,user_id='818cdd5f2ecf42739eb1d1d44c2d78e5',uuid=7f2e574f-a47c-45dc-9261-14de64d5ac7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converting VIF {"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.objects.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Object Instance<7f2e574f-a47c-45dc-9261-14de64d5ac7b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:48:47 user nova-compute[73476]:   <uuid>7f2e574f-a47c-45dc-9261-14de64d5ac7b</uuid>
Aug 26 20:48:47 user nova-compute[73476]:   <name>instance-0000000f</name>
Aug 26 20:48:47 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:48:47 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:48:47 user nova-compute[73476]:   <metadata>
Aug 26 20:48:47 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:48:47 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:48:47 user nova-compute[73476]:       <nova:name>tempest-TestMinimumBasicScenario-server-156038062</nova:name>
Aug 26 20:48:47 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:48:45</nova:creationTime>
Aug 26 20:48:47 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:48:47 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:48:47 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:48:47 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:48:47 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:48:47 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:48:47 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:48:47 user nova-compute[73476]:       <nova:owner>
Aug 26 20:48:47 user nova-compute[73476]:         <nova:user uuid="818cdd5f2ecf42739eb1d1d44c2d78e5">tempest-TestMinimumBasicScenario-1097465264-project-member</nova:user>
Aug 26 20:48:47 user nova-compute[73476]:         <nova:project uuid="1c0bf9d46b5447a495d0cf45071e0c27">tempest-TestMinimumBasicScenario-1097465264</nova:project>
Aug 26 20:48:47 user nova-compute[73476]:       </nova:owner>
Aug 26 20:48:47 user nova-compute[73476]:       <nova:root type="image" uuid="90f6bd11-46de-438c-b4ec-77bdac4447f7"/>
Aug 26 20:48:47 user nova-compute[73476]:       <nova:ports>
Aug 26 20:48:47 user nova-compute[73476]:         <nova:port uuid="31732c2a-94a0-4be3-b5f5-fbb1488b7161">
Aug 26 20:48:47 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 20:48:47 user nova-compute[73476]:         </nova:port>
Aug 26 20:48:47 user nova-compute[73476]:       </nova:ports>
Aug 26 20:48:47 user nova-compute[73476]:     </nova:instance>
Aug 26 20:48:47 user nova-compute[73476]:   </metadata>
Aug 26 20:48:47 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:48:47 user nova-compute[73476]:     <system>
Aug 26 20:48:47 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:48:47 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:48:47 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:48:47 user nova-compute[73476]:       <entry name="serial">7f2e574f-a47c-45dc-9261-14de64d5ac7b</entry>
Aug 26 20:48:47 user nova-compute[73476]:       <entry name="uuid">7f2e574f-a47c-45dc-9261-14de64d5ac7b</entry>
Aug 26 20:48:47 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:48:47 user nova-compute[73476]:     </system>
Aug 26 20:48:47 user nova-compute[73476]:   </sysinfo>
Aug 26 20:48:47 user nova-compute[73476]:   <os>
Aug 26 20:48:47 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:48:47 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:48:47 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:48:47 user nova-compute[73476]:   </os>
Aug 26 20:48:47 user nova-compute[73476]:   <features>
Aug 26 20:48:47 user nova-compute[73476]:     <acpi/>
Aug 26 20:48:47 user nova-compute[73476]:     <apic/>
Aug 26 20:48:47 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:48:47 user nova-compute[73476]:   </features>
Aug 26 20:48:47 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:48:47 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:48:47 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:48:47 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:48:47 user nova-compute[73476]:   </clock>
Aug 26 20:48:47 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:48:47 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:48:47 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:48:47 user nova-compute[73476]:   </cpu>
Aug 26 20:48:47 user nova-compute[73476]:   <devices>
Aug 26 20:48:47 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:48:47 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:48:47 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk"/>
Aug 26 20:48:47 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:48:47 user nova-compute[73476]:     </disk>
Aug 26 20:48:47 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:48:47 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:48:47 user nova-compute[73476]:       <source dev="/dev/sdd"/>
Aug 26 20:48:47 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:48:47 user nova-compute[73476]:       <serial>971018e8-7d57-466a-a4cf-51465d1beabc</serial>
Aug 26 20:48:47 user nova-compute[73476]:     </disk>
Aug 26 20:48:47 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:48:47 user nova-compute[73476]:       <mac address="fa:16:3e:1b:25:fc"/>
Aug 26 20:48:47 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:48:47 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:48:47 user nova-compute[73476]:       <target dev="tap31732c2a-94"/>
Aug 26 20:48:47 user nova-compute[73476]:     </interface>
Aug 26 20:48:47 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:48:47 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/console.log" append="off"/>
Aug 26 20:48:47 user nova-compute[73476]:     </serial>
Aug 26 20:48:47 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:48:47 user nova-compute[73476]:     <video>
Aug 26 20:48:47 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:48:47 user nova-compute[73476]:     </video>
Aug 26 20:48:47 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:48:47 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:48:47 user nova-compute[73476]:     </rng>
Aug 26 20:48:47 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:48:47 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:48:47 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:48:47 user nova-compute[73476]:     </memballoon>
Aug 26 20:48:47 user nova-compute[73476]:   </devices>
Aug 26 20:48:47 user nova-compute[73476]: </domain>
Aug 26 20:48:47 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-612ed36a-6f33-4a2f-95ab-b7389bde7b66 req-005d887c-9c1b-4fa5-b7fb-8b24239f041c service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-612ed36a-6f33-4a2f-95ab-b7389bde7b66 req-005d887c-9c1b-4fa5-b7fb-8b24239f041c service nova] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-612ed36a-6f33-4a2f-95ab-b7389bde7b66 req-005d887c-9c1b-4fa5-b7fb-8b24239f041c service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-612ed36a-6f33-4a2f-95ab-b7389bde7b66 req-005d887c-9c1b-4fa5-b7fb-8b24239f041c service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-612ed36a-6f33-4a2f-95ab-b7389bde7b66 req-005d887c-9c1b-4fa5-b7fb-8b24239f041c service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] No waiting events found dispatching network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:47 user nova-compute[73476]: WARNING nova.compute.manager [req-612ed36a-6f33-4a2f-95ab-b7389bde7b66 req-005d887c-9c1b-4fa5-b7fb-8b24239f041c service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received unexpected event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG nova.objects.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Object Instance<7f2e574f-a47c-45dc-9261-14de64d5ac7b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:48:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Cannot resize image /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG nova.objects.instance [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'migration_context' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG nova.objects.base [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Object Instance<7f2e574f-a47c-45dc-9261-14de64d5ac7b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-156038062',display_name='tempest-TestMinimumBasicScenario-server-156038062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-156038062',id=15,image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkJCbzXhqk2qkP5QbVoSQJsfJpi0quIEXOrN1Y/M8/7w5E0N6PnAbbhRBVuWJG+5R2Z7GtWVh0b63siP4vpOV4BZpC3h7aMxmwFg7L7UHYfBWP0Fi7o7fm8PbJV8DrNFw==',key_name='tempest-TestMinimumBasicScenario-802005258',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1c0bf9d46b5447a495d0cf45071e0c27',ramdisk_id='',reservation_id='r-nljd6hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1097465264',owner_user_name='tempest-TestMinimumBasicScenario-1097465264-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:45Z,user_data=None,user_id='818cdd5f2ecf42739eb1d1d44c2d78e5',uuid=7f2e574f-a47c-45dc-9261-14de64d5ac7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converting VIF {"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG os_vif [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31732c2a-94, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31732c2a-94, col_values=(('external_ids', {'iface-id': '31732c2a-94a0-4be3-b5f5-fbb1488b7161', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:25:fc', 'vm-uuid': '7f2e574f-a47c-45dc-9261-14de64d5ac7b'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:48:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:48 user nova-compute[73476]: INFO os_vif [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94')
Aug 26 20:48:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-cfa913a7-3cff-4689-bccc-1891085f3325 req-2792f395-d6bf-42ea-b299-1ad03d0b7840 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cfa913a7-3cff-4689-bccc-1891085f3325 req-2792f395-d6bf-42ea-b299-1ad03d0b7840 service nova] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cfa913a7-3cff-4689-bccc-1891085f3325 req-2792f395-d6bf-42ea-b299-1ad03d0b7840 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cfa913a7-3cff-4689-bccc-1891085f3325 req-2792f395-d6bf-42ea-b299-1ad03d0b7840 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-cfa913a7-3cff-4689-bccc-1891085f3325 req-2792f395-d6bf-42ea-b299-1ad03d0b7840 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] No waiting events found dispatching network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:49 user nova-compute[73476]: WARNING nova.compute.manager [req-cfa913a7-3cff-4689-bccc-1891085f3325 req-2792f395-d6bf-42ea-b299-1ad03d0b7840 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received unexpected event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 20:48:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for 7f2e574f-a47c-45dc-9261-14de64d5ac7b due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082932.0469847, 7f2e574f-a47c-45dc-9261-14de64d5ac7b => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] VM Resumed (Lifecycle Event)
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:48:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Instance rebooted successfully.
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-b7883309-2aec-45eb-af81-d7a5d7e75149 req-b6b3b18f-6d7c-4d8c-be24-16bebde37b8b service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b7883309-2aec-45eb-af81-d7a5d7e75149 req-b6b3b18f-6d7c-4d8c-be24-16bebde37b8b service nova] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b7883309-2aec-45eb-af81-d7a5d7e75149 req-b6b3b18f-6d7c-4d8c-be24-16bebde37b8b service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b7883309-2aec-45eb-af81-d7a5d7e75149 req-b6b3b18f-6d7c-4d8c-be24-16bebde37b8b service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-b7883309-2aec-45eb-af81-d7a5d7e75149 req-b6b3b18f-6d7c-4d8c-be24-16bebde37b8b service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] No waiting events found dispatching network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:48:52 user nova-compute[73476]: WARNING nova.compute.manager [req-b7883309-2aec-45eb-af81-d7a5d7e75149 req-b6b3b18f-6d7c-4d8c-be24-16bebde37b8b service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received unexpected event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 20:48:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082932.0497065, 7f2e574f-a47c-45dc-9261-14de64d5ac7b => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:48:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] VM Started (Lifecycle Event)
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-240271f5-e0e0-4093-a2f4-ca80362596a0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.766s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:48:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:48:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:54 user nova-compute[73476]: INFO nova.virt.block_device [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Booting with volume 35e37471-fa92-49b6-889f-f3579b631e34 at /dev/vdc
Aug 26 20:48:54 user nova-compute[73476]: DEBUG os_brick.utils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1240209-ac70-4fb7-9323-a9e6a901dd80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa7fe93-8716-410e-b82f-b4bc6b3625e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f33b4d-27bf-447a-af81-641664d4ad41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[462ed410-0c7a-4247-a311-929caabb3cce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:48:54 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:48:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[629ed9e0-6f68-4215-981b-ba43d9b102bc]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG os_brick.utils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:48:54 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating existing volume attachment record: 31e7c38d-de7c-4742-88ec-fc5e6794e4d6 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:48:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:48:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-ddcf61f6-b438-441a-8939-ed1d7c68cd56 req-e56c82b3-4606-4491-a577-4c529871d0a7 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received event network-changed-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:48:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-ddcf61f6-b438-441a-8939-ed1d7c68cd56 req-e56c82b3-4606-4491-a577-4c529871d0a7 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Refreshing instance network info cache due to event network-changed-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:48:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ddcf61f6-b438-441a-8939-ed1d7c68cd56 req-e56c82b3-4606-4491-a577-4c529871d0a7 service nova] Acquiring lock "refresh_cache-669c98c1-efd4-4119-8ad1-6adc20eb210d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:48:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ddcf61f6-b438-441a-8939-ed1d7c68cd56 req-e56c82b3-4606-4491-a577-4c529871d0a7 service nova] Acquired lock "refresh_cache-669c98c1-efd4-4119-8ad1-6adc20eb210d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:48:58 user nova-compute[73476]: DEBUG nova.network.neutron [req-ddcf61f6-b438-441a-8939-ed1d7c68cd56 req-e56c82b3-4606-4491-a577-4c529871d0a7 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Refreshing network info cache for port fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:48:59 user nova-compute[73476]: DEBUG nova.network.neutron [req-ddcf61f6-b438-441a-8939-ed1d7c68cd56 req-e56c82b3-4606-4491-a577-4c529871d0a7 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Updated VIF entry in instance network info cache for port fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:48:59 user nova-compute[73476]: DEBUG nova.network.neutron [req-ddcf61f6-b438-441a-8939-ed1d7c68cd56 req-e56c82b3-4606-4491-a577-4c529871d0a7 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Updating instance_info_cache with network_info: [{"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:48:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ddcf61f6-b438-441a-8939-ed1d7c68cd56 req-e56c82b3-4606-4491-a577-4c529871d0a7 service nova] Releasing lock "refresh_cache-669c98c1-efd4-4119-8ad1-6adc20eb210d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:48:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHpOoNWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:05 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:05 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:05 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56ef73-1ab9-474d-b951-cc38cc07900b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:49:05 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aacafcd-2e45-497c-a91b-5141a6603ba6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9] added
Aug 26 20:49:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bab443-5b07-4a8c-aa3e-2bddd4b82443]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f0e357-caf3-4aae-928b-f32bef1ae11f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHpOoNWv {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHpOoNWv" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1f2301-92fc-481e-8314-deb992ed8590]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VHpOoNWv'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ed134c-8f1f-42ed-87f5-d22f50916898]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8736c6c-0e38-480e-8c13-f6827a0c20b2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa29b5d3-bf66-4ddb-84e1-f2c2af67407a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9, portal: 172.16.0.220,3260]
Aug 26 20:49:05 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9, portal: 172.16.0.220,3260] successful.
Aug 26 20:49:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db36fa-ca43-44c2-8c22-0bd84d84b25a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea746af-d14d-495e-a029-20ee29b27735]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:05 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba8c0e-476c-4755-bf38-a0b6e936191c]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHpOoNWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:05 user nova-compute[73476]: DEBUG nova.objects.instance [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lazy-loading 'flavor' on Instance uuid 669c98c1-efd4-4119-8ad1-6adc20eb210d {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:06 user nova-compute[73476]: INFO nova.compute.manager [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Attaching volume 18d1c762-7624-4c3c-a7d4-4ebfbab7d597 to /dev/sdc
Aug 26 20:49:06 user nova-compute[73476]: DEBUG os_brick.utils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a72920-dd20-4f2a-9565-baf2caaa7717]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[68433ad8-5a8e-4557-900d-9e4dde6b5758]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a21b4c3-2194-4db8-8cfe-1e2d6891e7aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcecc80-1ca5-4a5a-9b60-ec93fa293c2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:49:06 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:49:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[64edab24-8717-433c-af45-829d79e77c22]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG os_brick.utils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Updating existing volume attachment record: 520318a7-252e-451a-b479-558cabdfabe1 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.463s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26634353463353434', 'path': '/dev/sdg'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634353463353434', 'path': '/dev/sdg'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'flavor' on Instance uuid 820f7ca5-8bf5-494d-8dae-b0ee3431f156 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:49:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:49:06 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:49:06 user nova-compute[73476]:   <source dev="/dev/sdg"/>
Aug 26 20:49:06 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:49:06 user nova-compute[73476]:   <serial>e6ecb1c9-be89-4bb3-a1b1-db256c5606b9</serial>
Aug 26 20:49:06 user nova-compute[73476]: </disk>
Aug 26 20:49:06 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:49:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:49:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:49:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No VIF found with MAC fa:16:3e:4f:3d:52, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:49:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f60e4000-137e-4d23-b258-0e4af9621679 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.239s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:49:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Creating image(s)
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Ensure instance console log exists: /opt/stack/data/nova/instances/5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Start _get_guest_xml network_info=[{"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '484812d5-4638-423d-bc83-2dd7981dd271', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfqRsvdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb', 'attached_at': '', 'detached_at': '', 'volume_id': '63c1d1b3-ffad-4325-aaef-fe223054c8f0', 'serial': '63c1d1b3-ffad-4325-aaef-fe223054c8f0'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': 'd98478a3-06fc-4739-acb6-3c27521148df', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwpnKXvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb', 'attached_at': '', 'detached_at': '', 'volume_id': '9febb691-5958-42d0-92ac-3cc5ad5ecdfa', 'serial': '9febb691-5958-42d0-92ac-3cc5ad5ecdfa'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '31e7c38d-de7c-4742-88ec-fc5e6794e4d6', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfBDRMSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb', 'attached_at': '', 'detached_at': '', 'volume_id': '35e37471-fa92-49b6-889f-f3579b631e34', 'serial': '35e37471-fa92-49b6-889f-f3579b631e34'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:49:10 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:49:10 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfqRsvdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:10 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:10 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:10 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5679058d-e85a-4a2d-b2ef-3499c5e70235]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:49:10 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8b22c3-3a6b-441d-87c1-9989e7202238]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0] added
Aug 26 20:49:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc524f5f-ce61-4bc0-b6e8-63901a3a5b78]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61f3b7c-17d8-4ffe-9ebb-446504c5deaa]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfqRsvdH {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfqRsvdH" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d239725c-3996-4178-9074-38e3277d972f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfqRsvdH'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d884fdb0-d354-4a58-99a8-a4a5c7e27cd8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[11db174d-6be5-4baf-b2ad-edc9ee207393]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a853343-8de4-4f6b-9276-5ee8b602cd97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0, portal: 172.16.0.220,3260]
Aug 26 20:49:10 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0, portal: 172.16.0.220,3260] successful.
Aug 26 20:49:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca22fbe8-5e88-4f47-99cd-093f466dddf1]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd9d16d-9269-4367-940f-10245b9aebb5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] HCTL ('40', '-', '-', 0) found on session 25 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[448a99d5-c9eb-4d3c-839e-0ec6fa2a239e]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Searching for a device in session 25 and hctl ['40', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Searching for a device in session 25 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfqRsvdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26662383237666136', 'path': '/dev/sdi'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662383237666136', 'path': '/dev/sdi'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwpnKXvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:11 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:11 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:11 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:49:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0569ef30-8169-438d-9f47-b2d8ecbba6ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:49:11 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb843d9-8c2d-4ce6-b5b2-18e9c7da1635]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa] added
Aug 26 20:49:11 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a4a109-048f-445e-b6c1-93e70aa9b79d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.211s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb467f2-fd0c-4f2c-a911-e646b6d07f68]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JwpnKXvM {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JwpnKXvM" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7912797b-147f-43a8-bc8a-e098ca5921ba]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JwpnKXvM'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8670ebe1-8e6b-497e-b332-0394893cd381]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40a7b1c-07a7-4b7a-9105-26ea9ce6ad0c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b38c188-302c-42dd-abbd-a8340c9f6ce4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa, portal: 172.16.0.220,3260]
Aug 26 20:49:12 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa, portal: 172.16.0.220,3260] successful.
Aug 26 20:49:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a21cf-b6c0-455a-aa74-42345b7131fe]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:49:12 user nova-compute[73476]: INFO nova.compute.claims [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Claim successful on node user
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e36693b-bdc1-491d-820f-6b1087844ee5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:12 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.611s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] HCTL ('41', '-', '-', 0) found on session 26 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[076572b8-0db0-4c59-8a69-0d330e3c3ff4]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Searching for a device in session 26 and hctl ['41', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:12 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.network.neutron [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:49:13 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.policy [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecd8ed063c144eb694017e5750ee57a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98519bcea11642e6b491b3a0cb4616db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:49:13 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Creating image(s)
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "/opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "/opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "/opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Searching for a device in session 26 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwpnKXvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.645s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] <== connect_volume: return (1646ms) {'type': 'block', 'scsi_wwn': '23538633366373536', 'path': '/dev/sdj'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538633366373536', 'path': '/dev/sdj'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfBDRMSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:13 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:13 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:13 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.214s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa68de-688a-47d2-af49-c27c2f924489]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:49:13 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e440ed-dda8-4bc8-83d8-a60f81828e90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34] added
Aug 26 20:49:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f99719-7dfb-4b0f-a9a3-14e51b92b05f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e87910-8d7c-4d87-b441-fca30fb19829]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfBDRMSx {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfBDRMSx" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19a8b0f-cc55-4538-839e-221dbb0511d4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lfBDRMSx'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1932a076-f7a5-401e-9a48-20f4b2d7d23b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.219s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd17893-adaa-47d5-8ab1-60d8698b9753]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:13 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk 1073741824" returned: 0 in 0.062s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --login" returned: 0 in 0.143s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4cae87-5231-4fb3-bf35-1811f71ea61e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34, portal: 172.16.0.220,3260]
Aug 26 20:49:13 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34, portal: 172.16.0.220,3260] successful.
Aug 26 20:49:13 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[904ceec3-81c5-452d-99d7-4365ce20cc65]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82826d0-1143-433d-9510-e7833fbcae04]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:14 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:14 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.522s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] HCTL ('42', '-', '-', 0) found on session 27 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG nova.network.neutron [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Successfully created port: bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.239s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfadfcb-7b03-4cf5-9bde-2bddf1c49d0e]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Searching for a device in session 27 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfBDRMSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Cannot resize image /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Ensure instance console log exists: /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG nova.network.neutron [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Successfully updated port: bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "refresh_cache-25d8bd18-3fc2-4494-aa6a-92e2b31550e1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquired lock "refresh_cache-25d8bd18-3fc2-4494-aa6a-92e2b31550e1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:49:14 user nova-compute[73476]: DEBUG nova.network.neutron [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-0f9b54d5-2b98-40bf-b10d-0ce212b6ff8f req-5790e9f5-f2ab-4722-b9d9-7cef9deb09fd service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received event network-changed-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-0f9b54d5-2b98-40bf-b10d-0ce212b6ff8f req-5790e9f5-f2ab-4722-b9d9-7cef9deb09fd service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Refreshing instance network info cache due to event network-changed-bac80087-8b43-462b-a88c-f70435e58b2c. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0f9b54d5-2b98-40bf-b10d-0ce212b6ff8f req-5790e9f5-f2ab-4722-b9d9-7cef9deb09fd service nova] Acquiring lock "refresh_cache-25d8bd18-3fc2-4494-aa6a-92e2b31550e1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.neutron [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.605s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] <== connect_volume: return (1608ms) {'type': 'block', 'scsi_wwn': '26463353761633964', 'path': '/dev/sdk'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463353761633964', 'path': '/dev/sdk'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7a2b1fb-8621-47fb-9630-01a6133a13b3,network=Network(e03a08da-e8ea-4325-ad8e-fb88bccc6b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a2b1fb-86') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc067c603-a4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:91:8a,bridge_name='br-int',has_traffic_filtering=True,id=420a36c6-a0de-4cad-af7d-19aae1ea7571,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap420a36c6-a0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:06:c4,bridge_name='br-int',has_traffic_filtering=True,id=cab225e4-c201-4e24-878b-34d0aedaa365,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab225e4-c2') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:e7,bridge_name='br-int',has_traffic_filtering=True,id=93c27189-8f35-4144-a932-fb997648e90e,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c27189-8f') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:4d,bridge_name='br-int',has_traffic_filtering=True,id=baeeff04-50ca-4ee8-b2f3-2437a3225a5a,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeeff04-50') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e9:ac,bridge_name='br-int',has_traffic_filtering=True,id=4384aff6-53bf-419c-b73d-50ae3c9fa1b7,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4384aff6-53') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.objects.instance [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:49:15 user nova-compute[73476]:   <uuid>5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb</uuid>
Aug 26 20:49:15 user nova-compute[73476]:   <name>instance-00000014</name>
Aug 26 20:49:15 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:49:15 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:49:15 user nova-compute[73476]:   <metadata>
Aug 26 20:49:15 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:49:15 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:name>tempest-device-tagging-server-1674380226</nova:name>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:49:10</nova:creationTime>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:49:15 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:49:15 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:owner>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:user uuid="4af3744acebb45cc912456b064371c64">tempest-TaggedBootDevicesTest-454866110-project-member</nova:user>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:project uuid="1411d212654847d688386973f7b6de8a">tempest-TaggedBootDevicesTest-454866110</nova:project>
Aug 26 20:49:15 user nova-compute[73476]:       </nova:owner>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:ports>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:port uuid="e7a2b1fb-8621-47fb-9630-01a6133a13b3">
Aug 26 20:49:15 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 20:49:15 user nova-compute[73476]:         </nova:port>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:port uuid="c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39">
Aug 26 20:49:15 user nova-compute[73476]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Aug 26 20:49:15 user nova-compute[73476]:         </nova:port>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:port uuid="420a36c6-a0de-4cad-af7d-19aae1ea7571">
Aug 26 20:49:15 user nova-compute[73476]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Aug 26 20:49:15 user nova-compute[73476]:         </nova:port>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:port uuid="cab225e4-c201-4e24-878b-34d0aedaa365">
Aug 26 20:49:15 user nova-compute[73476]:           <nova:ip type="fixed" address="10.1.1.133" ipVersion="4"/>
Aug 26 20:49:15 user nova-compute[73476]:         </nova:port>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:port uuid="93c27189-8f35-4144-a932-fb997648e90e">
Aug 26 20:49:15 user nova-compute[73476]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Aug 26 20:49:15 user nova-compute[73476]:         </nova:port>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:port uuid="baeeff04-50ca-4ee8-b2f3-2437a3225a5a">
Aug 26 20:49:15 user nova-compute[73476]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 20:49:15 user nova-compute[73476]:         </nova:port>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:port uuid="4384aff6-53bf-419c-b73d-50ae3c9fa1b7">
Aug 26 20:49:15 user nova-compute[73476]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 20:49:15 user nova-compute[73476]:         </nova:port>
Aug 26 20:49:15 user nova-compute[73476]:       </nova:ports>
Aug 26 20:49:15 user nova-compute[73476]:     </nova:instance>
Aug 26 20:49:15 user nova-compute[73476]:   </metadata>
Aug 26 20:49:15 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:49:15 user nova-compute[73476]:     <system>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="serial">5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="uuid">5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:49:15 user nova-compute[73476]:     </system>
Aug 26 20:49:15 user nova-compute[73476]:   </sysinfo>
Aug 26 20:49:15 user nova-compute[73476]:   <os>
Aug 26 20:49:15 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:49:15 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:49:15 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:49:15 user nova-compute[73476]:   </os>
Aug 26 20:49:15 user nova-compute[73476]:   <features>
Aug 26 20:49:15 user nova-compute[73476]:     <acpi/>
Aug 26 20:49:15 user nova-compute[73476]:     <apic/>
Aug 26 20:49:15 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:49:15 user nova-compute[73476]:   </features>
Aug 26 20:49:15 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:49:15 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:49:15 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:49:15 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:49:15 user nova-compute[73476]:   </clock>
Aug 26 20:49:15 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:49:15 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:49:15 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:49:15 user nova-compute[73476]:   </cpu>
Aug 26 20:49:15 user nova-compute[73476]:   <devices>
Aug 26 20:49:15 user nova-compute[73476]:     <disk type="file" device="cdrom">
Aug 26 20:49:15 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 20:49:15 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb/disk.config"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="hda" bus="ide"/>
Aug 26 20:49:15 user nova-compute[73476]:     </disk>
Aug 26 20:49:15 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:49:15 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:49:15 user nova-compute[73476]:       <source dev="/dev/sdi"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <serial>63c1d1b3-ffad-4325-aaef-fe223054c8f0</serial>
Aug 26 20:49:15 user nova-compute[73476]:     </disk>
Aug 26 20:49:15 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:49:15 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:49:15 user nova-compute[73476]:       <source dev="/dev/sdj"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <serial>9febb691-5958-42d0-92ac-3cc5ad5ecdfa</serial>
Aug 26 20:49:15 user nova-compute[73476]:     </disk>
Aug 26 20:49:15 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:49:15 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:49:15 user nova-compute[73476]:       <source dev="/dev/sdk"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="vdc" bus="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <serial>35e37471-fa92-49b6-889f-f3579b631e34</serial>
Aug 26 20:49:15 user nova-compute[73476]:     </disk>
Aug 26 20:49:15 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:49:15 user nova-compute[73476]:       <mac address="fa:16:3e:7e:a6:a1"/>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="tape7a2b1fb-86"/>
Aug 26 20:49:15 user nova-compute[73476]:     </interface>
Aug 26 20:49:15 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:49:15 user nova-compute[73476]:       <mac address="fa:16:3e:7e:b0:d2"/>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="tapc067c603-a4"/>
Aug 26 20:49:15 user nova-compute[73476]:     </interface>
Aug 26 20:49:15 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:49:15 user nova-compute[73476]:       <mac address="fa:16:3e:8f:91:8a"/>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="tap420a36c6-a0"/>
Aug 26 20:49:15 user nova-compute[73476]:     </interface>
Aug 26 20:49:15 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:49:15 user nova-compute[73476]:       <mac address="fa:16:3e:19:06:c4"/>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="tapcab225e4-c2"/>
Aug 26 20:49:15 user nova-compute[73476]:     </interface>
Aug 26 20:49:15 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:49:15 user nova-compute[73476]:       <mac address="fa:16:3e:74:dd:e7"/>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="tap93c27189-8f"/>
Aug 26 20:49:15 user nova-compute[73476]:     </interface>
Aug 26 20:49:15 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:49:15 user nova-compute[73476]:       <mac address="fa:16:3e:16:90:4d"/>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="tapbaeeff04-50"/>
Aug 26 20:49:15 user nova-compute[73476]:     </interface>
Aug 26 20:49:15 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:49:15 user nova-compute[73476]:       <mac address="fa:16:3e:65:e9:ac"/>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="tap4384aff6-53"/>
Aug 26 20:49:15 user nova-compute[73476]:     </interface>
Aug 26 20:49:15 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:49:15 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb/console.log" append="off"/>
Aug 26 20:49:15 user nova-compute[73476]:     </serial>
Aug 26 20:49:15 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:49:15 user nova-compute[73476]:     <video>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:     </video>
Aug 26 20:49:15 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:49:15 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:49:15 user nova-compute[73476]:     </rng>
Aug 26 20:49:15 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:49:15 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:49:15 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:49:15 user nova-compute[73476]:     </memballoon>
Aug 26 20:49:15 user nova-compute[73476]:   </devices>
Aug 26 20:49:15 user nova-compute[73476]: </domain>
Aug 26 20:49:15 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7a2b1fb-8621-47fb-9630-01a6133a13b3,network=Network(e03a08da-e8ea-4325-ad8e-fb88bccc6b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a2b1fb-86') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7a2b1fb-8621-47fb-9630-01a6133a13b3,network=Network(e03a08da-e8ea-4325-ad8e-fb88bccc6b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a2b1fb-86') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7a2b1fb-86, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7a2b1fb-86, col_values=(('external_ids', {'iface-id': 'e7a2b1fb-8621-47fb-9630-01a6133a13b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:a6:a1', 'vm-uuid': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: INFO os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7a2b1fb-8621-47fb-9630-01a6133a13b3,network=Network(e03a08da-e8ea-4325-ad8e-fb88bccc6b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a2b1fb-86')
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc067c603-a4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc067c603-a4') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc067c603-a4, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc067c603-a4, col_values=(('external_ids', {'iface-id': 'c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b0:d2', 'vm-uuid': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: INFO os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc067c603-a4')
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:91:8a,bridge_name='br-int',has_traffic_filtering=True,id=420a36c6-a0de-4cad-af7d-19aae1ea7571,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap420a36c6-a0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:91:8a,bridge_name='br-int',has_traffic_filtering=True,id=420a36c6-a0de-4cad-af7d-19aae1ea7571,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap420a36c6-a0') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap420a36c6-a0, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap420a36c6-a0, col_values=(('external_ids', {'iface-id': '420a36c6-a0de-4cad-af7d-19aae1ea7571', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:91:8a', 'vm-uuid': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: INFO os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:91:8a,bridge_name='br-int',has_traffic_filtering=True,id=420a36c6-a0de-4cad-af7d-19aae1ea7571,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap420a36c6-a0')
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:06:c4,bridge_name='br-int',has_traffic_filtering=True,id=cab225e4-c201-4e24-878b-34d0aedaa365,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab225e4-c2') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:06:c4,bridge_name='br-int',has_traffic_filtering=True,id=cab225e4-c201-4e24-878b-34d0aedaa365,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab225e4-c2') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcab225e4-c2, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcab225e4-c2, col_values=(('external_ids', {'iface-id': 'cab225e4-c201-4e24-878b-34d0aedaa365', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:06:c4', 'vm-uuid': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: INFO os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:06:c4,bridge_name='br-int',has_traffic_filtering=True,id=cab225e4-c201-4e24-878b-34d0aedaa365,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab225e4-c2')
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:e7,bridge_name='br-int',has_traffic_filtering=True,id=93c27189-8f35-4144-a932-fb997648e90e,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c27189-8f') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:e7,bridge_name='br-int',has_traffic_filtering=True,id=93c27189-8f35-4144-a932-fb997648e90e,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c27189-8f') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93c27189-8f, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93c27189-8f, col_values=(('external_ids', {'iface-id': '93c27189-8f35-4144-a932-fb997648e90e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:dd:e7', 'vm-uuid': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.neutron [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Updating instance_info_cache with network_info: [{"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Releasing lock "refresh_cache-25d8bd18-3fc2-4494-aa6a-92e2b31550e1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Instance network_info: |[{"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0f9b54d5-2b98-40bf-b10d-0ce212b6ff8f req-5790e9f5-f2ab-4722-b9d9-7cef9deb09fd service nova] Acquired lock "refresh_cache-25d8bd18-3fc2-4494-aa6a-92e2b31550e1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.neutron [req-0f9b54d5-2b98-40bf-b10d-0ce212b6ff8f req-5790e9f5-f2ab-4722-b9d9-7cef9deb09fd service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Refreshing network info cache for port bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Start _get_guest_xml network_info=[{"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: INFO os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:e7,bridge_name='br-int',has_traffic_filtering=True,id=93c27189-8f35-4144-a932-fb997648e90e,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c27189-8f')
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:4d,bridge_name='br-int',has_traffic_filtering=True,id=baeeff04-50ca-4ee8-b2f3-2437a3225a5a,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeeff04-50') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:4d,bridge_name='br-int',has_traffic_filtering=True,id=baeeff04-50ca-4ee8-b2f3-2437a3225a5a,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeeff04-50') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:49:15 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:49:15 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaeeff04-50, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbaeeff04-50, col_values=(('external_ids', {'iface-id': 'baeeff04-50ca-4ee8-b2f3-2437a3225a5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:90:4d', 'vm-uuid': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-300168865',display_name='tempest-AttachVolumeNegativeTest-server-300168865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-300168865',id=21,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHerluHkJYupt9Z60og6F4quPjSsMeEBJdzkiX/Ss1l39obOZsK+PM3r9scyb5hVI2E3auwCWFSzLp3hpEgEJjU7GBJkltNsajN3QgUxzGFXeDG+1lvi9CHFhrWKsaxucg==',key_name='tempest-keypair-410556146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-kdbe6ceh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:49:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=25d8bd18-3fc2-4494-aa6a-92e2b31550e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c9:9c,bridge_name='br-int',has_traffic_filtering=True,id=bac80087-8b43-462b-a88c-f70435e58b2c,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac80087-8b') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.objects.instance [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'pci_devices' on Instance uuid 25d8bd18-3fc2-4494-aa6a-92e2b31550e1 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: INFO os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:4d,bridge_name='br-int',has_traffic_filtering=True,id=baeeff04-50ca-4ee8-b2f3-2437a3225a5a,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeeff04-50')
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e9:ac,bridge_name='br-int',has_traffic_filtering=True,id=4384aff6-53bf-419c-b73d-50ae3c9fa1b7,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4384aff6-53') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e9:ac,bridge_name='br-int',has_traffic_filtering=True,id=4384aff6-53bf-419c-b73d-50ae3c9fa1b7,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4384aff6-53') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:49:15 user nova-compute[73476]:   <uuid>25d8bd18-3fc2-4494-aa6a-92e2b31550e1</uuid>
Aug 26 20:49:15 user nova-compute[73476]:   <name>instance-00000015</name>
Aug 26 20:49:15 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:49:15 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:49:15 user nova-compute[73476]:   <metadata>
Aug 26 20:49:15 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:49:15 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeNegativeTest-server-300168865</nova:name>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:49:15</nova:creationTime>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:49:15 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:49:15 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:owner>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:user uuid="ecd8ed063c144eb694017e5750ee57a9">tempest-AttachVolumeNegativeTest-745835648-project-member</nova:user>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:project uuid="98519bcea11642e6b491b3a0cb4616db">tempest-AttachVolumeNegativeTest-745835648</nova:project>
Aug 26 20:49:15 user nova-compute[73476]:       </nova:owner>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:49:15 user nova-compute[73476]:       <nova:ports>
Aug 26 20:49:15 user nova-compute[73476]:         <nova:port uuid="bac80087-8b43-462b-a88c-f70435e58b2c">
Aug 26 20:49:15 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:49:15 user nova-compute[73476]:         </nova:port>
Aug 26 20:49:15 user nova-compute[73476]:       </nova:ports>
Aug 26 20:49:15 user nova-compute[73476]:     </nova:instance>
Aug 26 20:49:15 user nova-compute[73476]:   </metadata>
Aug 26 20:49:15 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:49:15 user nova-compute[73476]:     <system>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="serial">25d8bd18-3fc2-4494-aa6a-92e2b31550e1</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="uuid">25d8bd18-3fc2-4494-aa6a-92e2b31550e1</entry>
Aug 26 20:49:15 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:49:15 user nova-compute[73476]:     </system>
Aug 26 20:49:15 user nova-compute[73476]:   </sysinfo>
Aug 26 20:49:15 user nova-compute[73476]:   <os>
Aug 26 20:49:15 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:49:15 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:49:15 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:49:15 user nova-compute[73476]:   </os>
Aug 26 20:49:15 user nova-compute[73476]:   <features>
Aug 26 20:49:15 user nova-compute[73476]:     <acpi/>
Aug 26 20:49:15 user nova-compute[73476]:     <apic/>
Aug 26 20:49:15 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:49:15 user nova-compute[73476]:   </features>
Aug 26 20:49:15 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:49:15 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:49:15 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:49:15 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:49:15 user nova-compute[73476]:   </clock>
Aug 26 20:49:15 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:49:15 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:49:15 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:49:15 user nova-compute[73476]:   </cpu>
Aug 26 20:49:15 user nova-compute[73476]:   <devices>
Aug 26 20:49:15 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:49:15 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:49:15 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:     </disk>
Aug 26 20:49:15 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:49:15 user nova-compute[73476]:       <mac address="fa:16:3e:76:c9:9c"/>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:49:15 user nova-compute[73476]:       <target dev="tapbac80087-8b"/>
Aug 26 20:49:15 user nova-compute[73476]:     </interface>
Aug 26 20:49:15 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:49:15 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/console.log" append="off"/>
Aug 26 20:49:15 user nova-compute[73476]:     </serial>
Aug 26 20:49:15 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:49:15 user nova-compute[73476]:     <video>
Aug 26 20:49:15 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:49:15 user nova-compute[73476]:     </video>
Aug 26 20:49:15 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:49:15 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:49:15 user nova-compute[73476]:     </rng>
Aug 26 20:49:15 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:49:15 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:49:15 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:49:15 user nova-compute[73476]:     </memballoon>
Aug 26 20:49:15 user nova-compute[73476]:   </devices>
Aug 26 20:49:15 user nova-compute[73476]: </domain>
Aug 26 20:49:15 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-300168865',display_name='tempest-AttachVolumeNegativeTest-server-300168865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-300168865',id=21,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHerluHkJYupt9Z60og6F4quPjSsMeEBJdzkiX/Ss1l39obOZsK+PM3r9scyb5hVI2E3auwCWFSzLp3hpEgEJjU7GBJkltNsajN3QgUxzGFXeDG+1lvi9CHFhrWKsaxucg==',key_name='tempest-keypair-410556146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-kdbe6ceh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:49:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=25d8bd18-3fc2-4494-aa6a-92e2b31550e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c9:9c,bridge_name='br-int',has_traffic_filtering=True,id=bac80087-8b43-462b-a88c-f70435e58b2c,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac80087-8b') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG os_vif [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c9:9c,bridge_name='br-int',has_traffic_filtering=True,id=bac80087-8b43-462b-a88c-f70435e58b2c,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac80087-8b') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4384aff6-53, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4384aff6-53, col_values=(('external_ids', {'iface-id': '4384aff6-53bf-419c-b73d-50ae3c9fa1b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:e9:ac', 'vm-uuid': '5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: INFO os_vif [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e9:ac,bridge_name='br-int',has_traffic_filtering=True,id=4384aff6-53bf-419c-b73d-50ae3c9fa1b7,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4384aff6-53')
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbac80087-8b, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbac80087-8b, col_values=(('external_ids', {'iface-id': 'bac80087-8b43-462b-a88c-f70435e58b2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:c9:9c', 'vm-uuid': '25d8bd18-3fc2-4494-aa6a-92e2b31550e1'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:15 user nova-compute[73476]: INFO os_vif [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c9:9c,bridge_name='br-int',has_traffic_filtering=True,id=bac80087-8b43-462b-a88c-f70435e58b2c,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac80087-8b')
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] No BDM found with device name hda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] No VIF found with MAC fa:16:3e:7e:a6:a1, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] No VIF found with MAC fa:16:3e:74:dd:e7, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:49:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Using config drive
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:49:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No VIF found with MAC fa:16:3e:76:c9:9c, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:49:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Creating config drive at /opt/stack/data/nova/instances/5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb/disk.config
Aug 26 20:49:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4fjj6v42 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4fjj6v42" returned: 0 in 0.062s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:16 user nova-compute[73476]: DEBUG nova.network.neutron [req-0f9b54d5-2b98-40bf-b10d-0ce212b6ff8f req-5790e9f5-f2ab-4722-b9d9-7cef9deb09fd service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Updated VIF entry in instance network info cache for port bac80087-8b43-462b-a88c-f70435e58b2c. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:49:16 user nova-compute[73476]: DEBUG nova.network.neutron [req-0f9b54d5-2b98-40bf-b10d-0ce212b6ff8f req-5790e9f5-f2ab-4722-b9d9-7cef9deb09fd service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Updating instance_info_cache with network_info: [{"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:49:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0f9b54d5-2b98-40bf-b10d-0ce212b6ff8f req-5790e9f5-f2ab-4722-b9d9-7cef9deb09fd service nova] Releasing lock "refresh_cache-25d8bd18-3fc2-4494-aa6a-92e2b31550e1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:49:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-bdcb052a-a286-482d-9d1c-ee7229101021 req-c774c4d8-1a77-45c3-b4b1-78f416661619 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received event network-vif-plugged-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bdcb052a-a286-482d-9d1c-ee7229101021 req-c774c4d8-1a77-45c3-b4b1-78f416661619 service nova] Acquiring lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bdcb052a-a286-482d-9d1c-ee7229101021 req-c774c4d8-1a77-45c3-b4b1-78f416661619 service nova] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bdcb052a-a286-482d-9d1c-ee7229101021 req-c774c4d8-1a77-45c3-b4b1-78f416661619 service nova] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-bdcb052a-a286-482d-9d1c-ee7229101021 req-c774c4d8-1a77-45c3-b4b1-78f416661619 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] No waiting events found dispatching network-vif-plugged-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:19 user nova-compute[73476]: WARNING nova.compute.manager [req-bdcb052a-a286-482d-9d1c-ee7229101021 req-c774c4d8-1a77-45c3-b4b1-78f416661619 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received unexpected event network-vif-plugged-bac80087-8b43-462b-a88c-f70435e58b2c for instance with vm_state building and task_state spawning.
Aug 26 20:49:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:19 user nova-compute[73476]: INFO nova.compute.manager [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Detaching volume c7e54bcb-5caa-4942-8d30-549dc6bd1311
Aug 26 20:49:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:19 user nova-compute[73476]: INFO nova.virt.block_device [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Attempting to driver detach volume c7e54bcb-5caa-4942-8d30-549dc6bd1311 from mountpoint /dev/vdb
Aug 26 20:49:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Attempting to detach device vdb from instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:49:19 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:49:19 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:49:19 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:49:19 user nova-compute[73476]:   <serial>c7e54bcb-5caa-4942-8d30-549dc6bd1311</serial>
Aug 26 20:49:19 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:49:19 user nova-compute[73476]: </disk>
Aug 26 20:49:19 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:49:19 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Successfully detached device vdb from instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 from the persistent domain config.
Aug 26 20:49:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:49:19 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:49:19 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:49:19 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:49:19 user nova-compute[73476]:   <serial>c7e54bcb-5caa-4942-8d30-549dc6bd1311</serial>
Aug 26 20:49:19 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:49:19 user nova-compute[73476]: </disk>
Aug 26 20:49:19 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693082960.1448712, 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:49:20 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Successfully detached device vdb from instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 from the live domain config.
Aug 26 20:49:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTnmFKgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:20 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dff0a58-c2e2-4a86-844b-ee803829c6f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b150f12-055e-4ccd-ad18-60e98fa6b0ad]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:20 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:20 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258cf32ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311'): ({'sdf'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Removing single pathed devices sdf {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e2cb14-2382-4fc1-84b5-d2a18f4fd558]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c250ee3c-6b2c-4191-8aaf-d491be8a73fe]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Flushing IO for device /dev/sdf {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0153b6f-0063-4ec4-94ca-1951a8e8e005]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf48399-9c51-4d35-978c-19339175e30b]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a435fda-dffc-4bcf-85ee-60af9380d57d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91bba5c-f778-40a8-85b0-affa025324d2]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311, portal: 172.16.0.220,3260]
Aug 26 20:49:20 user nova-compute[73476]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311, portal: 172.16.0.220,3260] successful.
Aug 26 20:49:20 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e54bcb-5caa-4942-8d30-549dc6bd1311 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.057s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b01613a-5ec1-4584-900a-d90a8006d164]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] <== disconnect_volume: return (389ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-c11b78d2-2477-4411-9332-101c1d816137 req-46a63fee-cbf1-4ab8-b0be-ed9fafba5dd8 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c11b78d2-2477-4411-9332-101c1d816137 req-46a63fee-cbf1-4ab8-b0be-ed9fafba5dd8 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c11b78d2-2477-4411-9332-101c1d816137 req-46a63fee-cbf1-4ab8-b0be-ed9fafba5dd8 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c11b78d2-2477-4411-9332-101c1d816137 req-46a63fee-cbf1-4ab8-b0be-ed9fafba5dd8 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-c11b78d2-2477-4411-9332-101c1d816137 req-46a63fee-cbf1-4ab8-b0be-ed9fafba5dd8 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:21 user nova-compute[73476]: WARNING nova.compute.manager [req-c11b78d2-2477-4411-9332-101c1d816137 req-46a63fee-cbf1-4ab8-b0be-ed9fafba5dd8 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-93c27189-8f35-4144-a932-fb997648e90e for instance with vm_state building and task_state spawning.
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received event network-vif-plugged-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Acquiring lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] No waiting events found dispatching network-vif-plugged-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:21 user nova-compute[73476]: WARNING nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received unexpected event network-vif-plugged-bac80087-8b43-462b-a88c-f70435e58b2c for instance with vm_state building and task_state spawning.
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:21 user nova-compute[73476]: WARNING nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 for instance with vm_state building and task_state spawning.
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:21 user nova-compute[73476]: WARNING nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 for instance with vm_state building and task_state spawning.
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:21 user nova-compute[73476]: WARNING nova.compute.manager [req-e404c087-7374-46d5-90d2-447eecb0cb82 req-47aa24c3-9332-42a6-aac3-e820e668f1db service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 for instance with vm_state building and task_state spawning.
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lazy-loading 'flavor' on Instance uuid 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f9965528-47c7-4609-a08f-31d8cea38681 tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.144s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-dbf7f43f-537a-4a1d-8e42-99181b8a2402 req-bdc683f5-91aa-4bc2-91c3-b9d2db66486a service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dbf7f43f-537a-4a1d-8e42-99181b8a2402 req-bdc683f5-91aa-4bc2-91c3-b9d2db66486a service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dbf7f43f-537a-4a1d-8e42-99181b8a2402 req-bdc683f5-91aa-4bc2-91c3-b9d2db66486a service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dbf7f43f-537a-4a1d-8e42-99181b8a2402 req-bdc683f5-91aa-4bc2-91c3-b9d2db66486a service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-dbf7f43f-537a-4a1d-8e42-99181b8a2402 req-bdc683f5-91aa-4bc2-91c3-b9d2db66486a service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:21 user nova-compute[73476]: WARNING nova.compute.manager [req-dbf7f43f-537a-4a1d-8e42-99181b8a2402 req-bdc683f5-91aa-4bc2-91c3-b9d2db66486a service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 for instance with vm_state building and task_state spawning.
Aug 26 20:49:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETrSnmaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:22 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:22 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:22 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:49:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d96d425-005a-40e5-a7e6-04d189b95f60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:49:22 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acaaf5c-2746-471f-9270-5adc445e265a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597] added
Aug 26 20:49:22 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082962.5664601, 25d8bd18-3fc2-4494-aa6a-92e2b31550e1 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:49:22 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] VM Resumed (Lifecycle Event)
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:49:22 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Instance spawned successfully.
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d17150-96b2-468b-8f9c-0159b28596b0]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f0eba-8920-4aef-87ae-c5d7c963d858]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETrSnmaz {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETrSnmaz" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1df9ca9-ea5c-46f3-9cbe-85cc0efb4541]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ETrSnmaz'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.115s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bde17d-7801-4373-8e8d-931c1f4a3491]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:22 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082962.5700004, 25d8bd18-3fc2-4494-aa6a-92e2b31550e1 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:49:22 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] VM Started (Lifecycle Event)
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56f880-5b13-4e0e-87b8-04c01ffadf6d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:22 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:22 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:22 user nova-compute[73476]: INFO nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Took 9.53 seconds to spawn the instance on the hypervisor.
Aug 26 20:49:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:49:22 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:49:22 user nova-compute[73476]: INFO nova.compute.manager [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Took 10.57 seconds to build instance.
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19aba58-962e-40a6-bfa7-6c4582b69953]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597, portal: 172.16.0.220,3260]
Aug 26 20:49:22 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597, portal: 172.16.0.220,3260] successful.
Aug 26 20:49:22 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-396cb5d0-0857-4c14-8f5e-e97675a4428a tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.705s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7f2e8c-63ca-4cbe-9571-46072cc21268]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b82e31b-8db4-4be3-868e-a3e204a80ca6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 (non-flash)
Aug 26 20:49:23 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.544s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8130ff7-04f9-4693-b2d7-d7f5aa419eb7]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETrSnmaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:23 user nova-compute[73476]: WARNING nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 for instance with vm_state building and task_state spawning.
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:23 user nova-compute[73476]: WARNING nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 for instance with vm_state building and task_state spawning.
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:23 user nova-compute[73476]: WARNING nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 for instance with vm_state building and task_state spawning.
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:23 user nova-compute[73476]: WARNING nova.compute.manager [req-082fca8e-ff4f-419d-93fa-a537cf7d3ed6 req-8f55f233-26bc-40f4-8108-e4a5cdd3b2c7 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-cab225e4-c201-4e24-878b-34d0aedaa365 for instance with vm_state building and task_state spawning.
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-ffce2062-f245-4878-89ef-3cd714973170 req-622a4a83-2d71-4fe7-a1c4-e09ab2b7643f service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ffce2062-f245-4878-89ef-3cd714973170 req-622a4a83-2d71-4fe7-a1c4-e09ab2b7643f service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ffce2062-f245-4878-89ef-3cd714973170 req-622a4a83-2d71-4fe7-a1c4-e09ab2b7643f service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ffce2062-f245-4878-89ef-3cd714973170 req-622a4a83-2d71-4fe7-a1c4-e09ab2b7643f service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-ffce2062-f245-4878-89ef-3cd714973170 req-622a4a83-2d71-4fe7-a1c4-e09ab2b7643f service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:23 user nova-compute[73476]: WARNING nova.compute.manager [req-ffce2062-f245-4878-89ef-3cd714973170 req-622a4a83-2d71-4fe7-a1c4-e09ab2b7643f service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-93c27189-8f35-4144-a932-fb997648e90e for instance with vm_state building and task_state spawning.
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-75e397fe-2f26-410e-b61f-d2ad84393e5a req-237c31b4-0618-4b1b-8a6f-504e4e5aefe6 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-75e397fe-2f26-410e-b61f-d2ad84393e5a req-237c31b4-0618-4b1b-8a6f-504e4e5aefe6 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-75e397fe-2f26-410e-b61f-d2ad84393e5a req-237c31b4-0618-4b1b-8a6f-504e4e5aefe6 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-75e397fe-2f26-410e-b61f-d2ad84393e5a req-237c31b4-0618-4b1b-8a6f-504e4e5aefe6 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-75e397fe-2f26-410e-b61f-d2ad84393e5a req-237c31b4-0618-4b1b-8a6f-504e4e5aefe6 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:23 user nova-compute[73476]: WARNING nova.compute.manager [req-75e397fe-2f26-410e-b61f-d2ad84393e5a req-237c31b4-0618-4b1b-8a6f-504e4e5aefe6 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 for instance with vm_state building and task_state spawning.
Aug 26 20:49:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.602s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] <== connect_volume: return (1604ms) {'type': 'block', 'scsi_wwn': '23536383237333964', 'path': '/dev/sdf'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536383237333964', 'path': '/dev/sdf'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.objects.instance [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lazy-loading 'flavor' on Instance uuid 669c98c1-efd4-4119-8ad1-6adc20eb210d {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:49:24 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:49:24 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:49:24 user nova-compute[73476]:   <target dev="sdc" bus="scsi"/>
Aug 26 20:49:24 user nova-compute[73476]:   <serial>18d1c762-7624-4c3c-a7d4-4ebfbab7d597</serial>
Aug 26 20:49:24 user nova-compute[73476]:   <address type="drive" controller="0" unit="2"/>
Aug 26 20:49:24 user nova-compute[73476]: </disk>
Aug 26 20:49:24 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082964.3012016, 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:49:24 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] VM Resumed (Lifecycle Event)
Aug 26 20:49:24 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance spawned successfully.
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:49:24 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693082964.3014321, 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:49:24 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] VM Started (Lifecycle Event)
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:49:24 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:49:24 user nova-compute[73476]: INFO nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Took 14.19 seconds to spawn the instance on the hypervisor.
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:49:24 user nova-compute[73476]: INFO nova.compute.manager [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Took 62.21 seconds to build instance.
Aug 26 20:49:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c6d18690-0c28-47d7-860c-e41006f9f5e4 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.320s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] No BDM found with device name sda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] No VIF found with MAC fa:16:3e:ae:25:7c, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:49:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8c89ade4-2ca6-46c2-b4f6-2f204400fcae tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.633s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:25 user nova-compute[73476]: WARNING nova.compute.manager [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-cab225e4-c201-4e24-878b-34d0aedaa365 for instance with vm_state active and task_state None.
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:25 user nova-compute[73476]: WARNING nova.compute.manager [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a for instance with vm_state active and task_state None.
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:25 user nova-compute[73476]: WARNING nova.compute.manager [req-bcff886a-8d5a-4254-b20b-98c871719cc5 req-843ab4b9-409d-4c95-938d-7bb5b66ba410 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a for instance with vm_state active and task_state None.
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:25 user nova-compute[73476]: INFO nova.compute.manager [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Detaching volume 18d1c762-7624-4c3c-a7d4-4ebfbab7d597
Aug 26 20:49:25 user nova-compute[73476]: INFO nova.virt.block_device [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Attempting to driver detach volume 18d1c762-7624-4c3c-a7d4-4ebfbab7d597 from mountpoint /dev/sdc
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Attempting to detach device sdc from instance 669c98c1-efd4-4119-8ad1-6adc20eb210d from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:49:25 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:49:25 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:49:25 user nova-compute[73476]:   <target dev="sdc" bus="scsi"/>
Aug 26 20:49:25 user nova-compute[73476]:   <serial>18d1c762-7624-4c3c-a7d4-4ebfbab7d597</serial>
Aug 26 20:49:25 user nova-compute[73476]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 20:49:25 user nova-compute[73476]: </disk>
Aug 26 20:49:25 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:49:25 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Successfully detached device sdc from instance 669c98c1-efd4-4119-8ad1-6adc20eb210d from the persistent domain config.
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 669c98c1-efd4-4119-8ad1-6adc20eb210d from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:49:25 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:49:25 user nova-compute[73476]:   <source dev="/dev/sdf"/>
Aug 26 20:49:25 user nova-compute[73476]:   <target dev="sdc" bus="scsi"/>
Aug 26 20:49:25 user nova-compute[73476]:   <serial>18d1c762-7624-4c3c-a7d4-4ebfbab7d597</serial>
Aug 26 20:49:25 user nova-compute[73476]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 20:49:25 user nova-compute[73476]: </disk>
Aug 26 20:49:25 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:49:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693082966.1521592, 669c98c1-efd4-4119-8ad1-6adc20eb210d => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 669c98c1-efd4-4119-8ad1-6adc20eb210d {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:49:26 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Successfully detached device sdc from instance 669c98c1-efd4-4119-8ad1-6adc20eb210d from the live domain config.
Aug 26 20:49:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETrSnmaz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:26 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.046s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbf48fb-4856-495a-8297-1c962aaa8ebb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ee4f3a-1f9b-4912-9f48-a789a880fbbe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 (non-flash)
Aug 26 20:49:26 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d012b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597'): ({'sdf'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Removing single pathed devices sdf {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4091cff-a9a0-4de2-885b-3ae0aadd8028]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e6f565-ad74-4c94-93bc-e5314285b363]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Flushing IO for device /dev/sdf {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ddd723-fd17-4ea2-bb4e-2c985abb7d0b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d9737-261b-4642-9152-bc1eafddaae5]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6473af-e916-4494-8219-b197d4319fc2]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9132c4f1-079b-46d8-8bdc-73804feed5ed]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597, portal: 172.16.0.220,3260]
Aug 26 20:49:26 user nova-compute[73476]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597, portal: 172.16.0.220,3260] successful.
Aug 26 20:49:26 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d1c762-7624-4c3c-a7d4-4ebfbab7d597 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb8726e-6738-4618-b269-791cd03804da]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] <== disconnect_volume: return (348ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:49:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:27 user nova-compute[73476]: DEBUG nova.objects.instance [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lazy-loading 'flavor' on Instance uuid 669c98c1-efd4-4119-8ad1-6adc20eb210d {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:49:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-69d9aca3-ab3d-402a-931c-228aa75ff7da tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.964s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:27 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:27 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:28 user nova-compute[73476]: INFO nova.compute.manager [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Terminating instance
Aug 26 20:49:28 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-5a0eb66e-4aed-417f-a66c-40ba2adca799 req-18f16def-786d-43a1-998e-dde28d8c8b57 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received event network-vif-unplugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5a0eb66e-4aed-417f-a66c-40ba2adca799 req-18f16def-786d-43a1-998e-dde28d8c8b57 service nova] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5a0eb66e-4aed-417f-a66c-40ba2adca799 req-18f16def-786d-43a1-998e-dde28d8c8b57 service nova] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5a0eb66e-4aed-417f-a66c-40ba2adca799 req-18f16def-786d-43a1-998e-dde28d8c8b57 service nova] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-5a0eb66e-4aed-417f-a66c-40ba2adca799 req-18f16def-786d-43a1-998e-dde28d8c8b57 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] No waiting events found dispatching network-vif-unplugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-5a0eb66e-4aed-417f-a66c-40ba2adca799 req-18f16def-786d-43a1-998e-dde28d8c8b57 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received event network-vif-unplugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Instance destroyed successfully.
Aug 26 20:49:29 user nova-compute[73476]: DEBUG nova.objects.instance [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lazy-loading 'resources' on Instance uuid 669c98c1-efd4-4119-8ad1-6adc20eb210d {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:47:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1726100241',display_name='tempest-AttachSCSIVolumeTestJSON-server-1726100241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1726100241',id=18,image_ref='8b32666b-b813-446e-83be-07f6d56cbd2b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1LYHf30KEFC2f3LIiWvJd3ukH0XlZkbLyGC5YSSKf94hQT8mJ8S6UV3ua80YJAU8ukCR1/Sgs2r376BSAZunohaAHK5SftsE/DIG21BGU+MMVv2Oufw2wQsZxRZlM3oQ==',key_name='tempest-keypair-216997835',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd406b8ee798404f8c2cf2837e842ecf',ramdisk_id='',reservation_id='r-dylatfo2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8b32666b-b813-446e-83be-07f6d56cbd2b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-471782709',owner_user_name='tempest-AttachSCSIVolumeTestJSON-471782709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:47:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64fb59ef9cc84f91a176089579e4ff5c',uuid=669c98c1-efd4-4119-8ad1-6adc20eb210d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Converting VIF {"id": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "address": "fa:16:3e:ae:25:7c", "network": {"id": "436e2baa-caf8-40a9-b8bf-394ee895b271", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1601758575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd406b8ee798404f8c2cf2837e842ecf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf5b765-7c", "ovs_interfaceid": "fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:25:7c,bridge_name='br-int',has_traffic_filtering=True,id=fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc,network=Network(436e2baa-caf8-40a9-b8bf-394ee895b271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf5b765-7c') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG os_vif [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:25:7c,bridge_name='br-int',has_traffic_filtering=True,id=fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc,network=Network(436e2baa-caf8-40a9-b8bf-394ee895b271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf5b765-7c') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdf5b765-7c, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:29 user nova-compute[73476]: INFO os_vif [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:25:7c,bridge_name='br-int',has_traffic_filtering=True,id=fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc,network=Network(436e2baa-caf8-40a9-b8bf-394ee895b271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf5b765-7c')
Aug 26 20:49:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Deleting instance files /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d_del
Aug 26 20:49:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Deletion of /opt/stack/data/nova/instances/669c98c1-efd4-4119-8ad1-6adc20eb210d_del complete
Aug 26 20:49:29 user nova-compute[73476]: INFO nova.compute.manager [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 20:49:29 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:49:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:49:30 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Took 1.13 seconds to deallocate network for instance.
Aug 26 20:49:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-d55613fe-c538-4ec9-8815-259cb9f22319 req-66e8fdf8-f564-408e-b8be-fad371031671 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received event network-vif-deleted-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-f3f8706b-4509-4e56-8dd2-8cbe658899ce req-7af7c9ef-ddb3-4706-85de-4f72d0943341 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received event network-vif-plugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f3f8706b-4509-4e56-8dd2-8cbe658899ce req-7af7c9ef-ddb3-4706-85de-4f72d0943341 service nova] Acquiring lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f3f8706b-4509-4e56-8dd2-8cbe658899ce req-7af7c9ef-ddb3-4706-85de-4f72d0943341 service nova] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f3f8706b-4509-4e56-8dd2-8cbe658899ce req-7af7c9ef-ddb3-4706-85de-4f72d0943341 service nova] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-f3f8706b-4509-4e56-8dd2-8cbe658899ce req-7af7c9ef-ddb3-4706-85de-4f72d0943341 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] No waiting events found dispatching network-vif-plugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:30 user nova-compute[73476]: WARNING nova.compute.manager [req-f3f8706b-4509-4e56-8dd2-8cbe658899ce req-7af7c9ef-ddb3-4706-85de-4f72d0943341 service nova] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Received unexpected event network-vif-plugged-fdf5b765-7c9a-485f-a53f-6dd88e5fd4cc for instance with vm_state deleted and task_state None.
Aug 26 20:49:30 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Deleted allocations for instance 669c98c1-efd4-4119-8ad1-6adc20eb210d
Aug 26 20:49:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0e638dbc-a002-4cf3-a6c7-74f89ec8fce3 tempest-AttachSCSIVolumeTestJSON-471782709 tempest-AttachSCSIVolumeTestJSON-471782709-project-member] Lock "669c98c1-efd4-4119-8ad1-6adc20eb210d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.775s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:31 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:33 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:33 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:35 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:49:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdk (vdc) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:49:40 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:49:40 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=6807MB free_disk=25.257366180419922GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance eaf9f058-2194-4e0e-9460-328108758c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ad42cf47-42fb-488f-a44f-cf9824dd4d99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ba24bae1-d608-41dd-b928-fad3ba415cc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 25d8bd18-3fc2-4494-aa6a-92e2b31550e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:49:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:49:41 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:49:41 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:49:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:49:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 22b50300-8865-4854-b0c7-ed63ca60c85b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updating instance_info_cache with network_info: [{"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:49:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:49:44 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082969.1506004, 669c98c1-efd4-4119-8ad1-6adc20eb210d => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:49:44 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] VM Stopped (Lifecycle Event)
Aug 26 20:49:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-082a767c-60b0-4f66-acf7-347a08c23952 None None] [instance: 669c98c1-efd4-4119-8ad1-6adc20eb210d] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:49:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:49:51 user nova-compute[73476]: INFO nova.compute.claims [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Claim successful on node user
Aug 26 20:49:51 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:49:51 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:49:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:49:51 user nova-compute[73476]: INFO nova.virt.block_device [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Booting with volume 3538703d-e8cc-4ed6-a7ea-a4377639b36b at /dev/vda
Aug 26 20:49:51 user nova-compute[73476]: DEBUG nova.policy [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c28d237e1730497f9b425a1b9bb1aaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6d618e1c9c4d42bb6572b5dcc2596a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG os_brick.utils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefb42e2-b2be-4fd2-a070-a8f92fa5f7a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e05eb00-c9f9-4aba-838b-a4a5dfe4d4c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3117142f-78ec-423c-862a-8794e31879b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ff6a3b-c7b4-49ae-a673-3319d688fcb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:49:51 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:49:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0364f979-a996-4949-a9c7-c4dbaf8865d0]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG os_brick.utils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:51 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating existing volume attachment record: be0aea59-31d4-455f-a3cc-eef55d5d15c9 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:49:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:52 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Successfully created port: d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Successfully updated port: d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquired lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG nova.compute.manager [req-93d3e546-1183-4b6d-bc06-160af2371863 req-18189829-6a20-46f7-936c-e42a92f66fb2 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG nova.compute.manager [req-93d3e546-1183-4b6d-bc06-160af2371863 req-18189829-6a20-46f7-936c-e42a92f66fb2 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing instance network info cache due to event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-93d3e546-1183-4b6d-bc06-160af2371863 req-18189829-6a20-46f7-936c-e42a92f66fb2 service nova] Acquiring lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating instance_info_cache with network_info: [{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Releasing lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Instance network_info: |[{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-93d3e546-1183-4b6d-bc06-160af2371863 req-18189829-6a20-46f7-936c-e42a92f66fb2 service nova] Acquired lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:49:53 user nova-compute[73476]: DEBUG nova.network.neutron [req-93d3e546-1183-4b6d-bc06-160af2371863 req-18189829-6a20-46f7-936c-e42a92f66fb2 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-93d3e546-1183-4b6d-bc06-160af2371863 req-18189829-6a20-46f7-936c-e42a92f66fb2 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updated VIF entry in instance network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-93d3e546-1183-4b6d-bc06-160af2371863 req-18189829-6a20-46f7-936c-e42a92f66fb2 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating instance_info_cache with network_info: [{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-6bc842aa-1fe0-463c-a7c4-680e3715cd07 req-4fd3661f-d44c-44a1-8a6d-8dd07054026e service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-changed-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-6bc842aa-1fe0-463c-a7c4-680e3715cd07 req-4fd3661f-d44c-44a1-8a6d-8dd07054026e service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Refreshing instance network info cache due to event network-changed-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6bc842aa-1fe0-463c-a7c4-680e3715cd07 req-4fd3661f-d44c-44a1-8a6d-8dd07054026e service nova] Acquiring lock "refresh_cache-ba24bae1-d608-41dd-b928-fad3ba415cc1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6bc842aa-1fe0-463c-a7c4-680e3715cd07 req-4fd3661f-d44c-44a1-8a6d-8dd07054026e service nova] Acquired lock "refresh_cache-ba24bae1-d608-41dd-b928-fad3ba415cc1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-6bc842aa-1fe0-463c-a7c4-680e3715cd07 req-4fd3661f-d44c-44a1-8a6d-8dd07054026e service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Refreshing network info cache for port c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:49:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-93d3e546-1183-4b6d-bc06-160af2371863 req-18189829-6a20-46f7-936c-e42a92f66fb2 service nova] Releasing lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:49:55 user nova-compute[73476]: DEBUG nova.network.neutron [req-6bc842aa-1fe0-463c-a7c4-680e3715cd07 req-4fd3661f-d44c-44a1-8a6d-8dd07054026e service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Updated VIF entry in instance network info cache for port c9c5fd68-f9ac-4e5b-882d-8dcc870fc942. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:49:55 user nova-compute[73476]: DEBUG nova.network.neutron [req-6bc842aa-1fe0-463c-a7c4-680e3715cd07 req-4fd3661f-d44c-44a1-8a6d-8dd07054026e service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Updating instance_info_cache with network_info: [{"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:49:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6bc842aa-1fe0-463c-a7c4-680e3715cd07 req-4fd3661f-d44c-44a1-8a6d-8dd07054026e service nova] Releasing lock "refresh_cache-ba24bae1-d608-41dd-b928-fad3ba415cc1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:49:55 user nova-compute[73476]: INFO nova.compute.manager [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Rebuilding instance
Aug 26 20:49:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance destroyed successfully.
Aug 26 20:49:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance destroyed successfully.
Aug 26 20:49:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1335220622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530961728',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwjoJwGNxGs7G8sGWzXNWPaMUrsR51iAkmlUCNqWZds597i69ly8h77pfkK/8WuXPB5E/6x9PUenKX8xpliIZdz/cCEW9R/w6nPEeKQAuV2ko7KXmy5CGuAoPNDGkI3Tg==',key_name='tempest-keypair-999954189',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:48:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f1adaa2e9f94156a674b7825b4c7b37',ramdisk_id='',reservation_id='r-mlfz9lcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1323308358',owner_user_name='tempest-ServerActionsV293TestJSON-1323308358-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89e2c5481c8d4a5a859f17b8af08626a',uuid=ba24bae1-d608-41dd-b928-fad3ba415cc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converting VIF {"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_vif [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9c5fd68-f9, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:49:56 user nova-compute[73476]: INFO os_vif [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9')
Aug 26 20:49:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDqHkzZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:56 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c09b234-a7ac-471a-978d-8745a904b1da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2c15a8-97cb-4858-8a2c-f69e73287811]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:56 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02a2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233'): ({'sde'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Removing single pathed devices sde {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ba0189-ace0-4a7d-9f1a-001c1480ca31]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b63a76d-56e0-46d9-be1f-12c6e2c7cf79]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Flushing IO for device /dev/sde {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG nova.compute.manager [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-unplugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG nova.compute.manager [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] No waiting events found dispatching network-vif-unplugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:56 user nova-compute[73476]: WARNING nova.compute.manager [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received unexpected event network-vif-unplugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 for instance with vm_state active and task_state rebuilding.
Aug 26 20:49:56 user nova-compute[73476]: DEBUG nova.compute.manager [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG nova.compute.manager [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] No waiting events found dispatching network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:49:56 user nova-compute[73476]: WARNING nova.compute.manager [req-4acc5429-d063-4534-b57c-07303fdccaa0 req-c8e8db19-a752-46bc-9f1c-2cb81e49e199 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received unexpected event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 for instance with vm_state active and task_state rebuilding.
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f92ce2-8bb4-4522-b0ec-76612e2efe7d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:49:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b29c3c4-c080-42a0-bb94-bbe8ba76d714]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO47ada1de-db795042be41cbd6', '/dev/disk/by-id/scsi-26462373935303432', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_47ada1de') {{(pid=84820) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e427e1cd-8eec-441d-85ac-e017629c9983]: (4, None) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb8805d-6609-446e-83c3-27ddc6a893a9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe8bbae-fc6e-457f-b87d-c2d181bf38da]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260]
Aug 26 20:49:57 user nova-compute[73476]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260] successful.
Aug 26 20:49:57 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6416be3-85e8-47c4-a98b-3e20f7caa8ca]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] <== disconnect_volume: return (351ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:49:57 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Deleting instance files /opt/stack/data/nova/instances/ba24bae1-d608-41dd-b928-fad3ba415cc1_del
Aug 26 20:49:57 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Deletion of /opt/stack/data/nova/instances/ba24bae1-d608-41dd-b928-fad3ba415cc1_del complete
Aug 26 20:49:57 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ba24bae1-d608-41dd-b928-fad3ba415cc1 could not be found.
Aug 26 20:49:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDqHkzZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:49:57 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef00698-90a3-4aa6-b45a-f66a691759d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58039f8-c003-43db-8961-4313dda828c7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:57 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:49:57 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:49:57 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b00fc280>, {}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Disconnecting from: [] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.059s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] <== disconnect_volume: return (60ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:49:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:49:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Preparing to wait for external event volume-reimaged-60eef670-6c83-45f8-85af-dc163f4ed233 {{(pid=73476) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 20:49:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:49:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:49:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:49:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "1dddc689-a053-46d4-a29e-52c8fe78c76d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:50:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:50:00 user nova-compute[73476]: INFO nova.compute.claims [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Claim successful on node user
Aug 26 20:50:01 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:50:01 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:50:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG nova.policy [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ed2a98f37294fd381fd1dfe7c5c0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679727d63ba04ad48740d1b967be5a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:50:01 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Creating image(s)
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "/opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "/opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.261s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk 1073741824" returned: 0 in 0.052s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Successfully created port: bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Cannot resize image /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Ensure instance console log exists: /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Successfully updated port: bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "refresh_cache-1dddc689-a053-46d4-a29e-52c8fe78c76d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquired lock "refresh_cache-1dddc689-a053-46d4-a29e-52c8fe78c76d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-19f857d3-96e0-42ab-ae6f-4adde990f2d8 req-56ea5e33-8aca-4fd6-a762-995d7dfe1967 service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received event network-changed-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-19f857d3-96e0-42ab-ae6f-4adde990f2d8 req-56ea5e33-8aca-4fd6-a762-995d7dfe1967 service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Refreshing instance network info cache due to event network-changed-bcb0b945-ae35-4b28-8629-d940710dd62b. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-19f857d3-96e0-42ab-ae6f-4adde990f2d8 req-56ea5e33-8aca-4fd6-a762-995d7dfe1967 service nova] Acquiring lock "refresh_cache-1dddc689-a053-46d4-a29e-52c8fe78c76d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Updating instance_info_cache with network_info: [{"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Releasing lock "refresh_cache-1dddc689-a053-46d4-a29e-52c8fe78c76d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Instance network_info: |[{"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-19f857d3-96e0-42ab-ae6f-4adde990f2d8 req-56ea5e33-8aca-4fd6-a762-995d7dfe1967 service nova] Acquired lock "refresh_cache-1dddc689-a053-46d4-a29e-52c8fe78c76d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-19f857d3-96e0-42ab-ae6f-4adde990f2d8 req-56ea5e33-8aca-4fd6-a762-995d7dfe1967 service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Refreshing network info cache for port bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Start _get_guest_xml network_info=[{"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:50:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:50:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-524100273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-524100273',id=23,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-5aa3cnzp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:50:01Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=1dddc689-a053-46d4-a29e-52c8fe78c76d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcb0b945-ae35-4b28-8629-d940710dd62b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb0b945-ae') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.objects.instance [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dddc689-a053-46d4-a29e-52c8fe78c76d {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:50:03 user nova-compute[73476]:   <uuid>1dddc689-a053-46d4-a29e-52c8fe78c76d</uuid>
Aug 26 20:50:03 user nova-compute[73476]:   <name>instance-00000017</name>
Aug 26 20:50:03 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:50:03 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:50:03 user nova-compute[73476]:   <metadata>
Aug 26 20:50:03 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:50:03 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:50:03 user nova-compute[73476]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-524100273</nova:name>
Aug 26 20:50:03 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:50:03</nova:creationTime>
Aug 26 20:50:03 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:50:03 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:50:03 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:50:03 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:50:03 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:50:03 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:50:03 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:50:03 user nova-compute[73476]:       <nova:owner>
Aug 26 20:50:03 user nova-compute[73476]:         <nova:user uuid="5ed2a98f37294fd381fd1dfe7c5c0751">tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member</nova:user>
Aug 26 20:50:03 user nova-compute[73476]:         <nova:project uuid="679727d63ba04ad48740d1b967be5a61">tempest-ServerBootFromVolumeStableRescueTest-735166680</nova:project>
Aug 26 20:50:03 user nova-compute[73476]:       </nova:owner>
Aug 26 20:50:03 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:50:03 user nova-compute[73476]:       <nova:ports>
Aug 26 20:50:03 user nova-compute[73476]:         <nova:port uuid="bcb0b945-ae35-4b28-8629-d940710dd62b">
Aug 26 20:50:03 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 20:50:03 user nova-compute[73476]:         </nova:port>
Aug 26 20:50:03 user nova-compute[73476]:       </nova:ports>
Aug 26 20:50:03 user nova-compute[73476]:     </nova:instance>
Aug 26 20:50:03 user nova-compute[73476]:   </metadata>
Aug 26 20:50:03 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:50:03 user nova-compute[73476]:     <system>
Aug 26 20:50:03 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:50:03 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:50:03 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:50:03 user nova-compute[73476]:       <entry name="serial">1dddc689-a053-46d4-a29e-52c8fe78c76d</entry>
Aug 26 20:50:03 user nova-compute[73476]:       <entry name="uuid">1dddc689-a053-46d4-a29e-52c8fe78c76d</entry>
Aug 26 20:50:03 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:50:03 user nova-compute[73476]:     </system>
Aug 26 20:50:03 user nova-compute[73476]:   </sysinfo>
Aug 26 20:50:03 user nova-compute[73476]:   <os>
Aug 26 20:50:03 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:50:03 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:50:03 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:50:03 user nova-compute[73476]:   </os>
Aug 26 20:50:03 user nova-compute[73476]:   <features>
Aug 26 20:50:03 user nova-compute[73476]:     <acpi/>
Aug 26 20:50:03 user nova-compute[73476]:     <apic/>
Aug 26 20:50:03 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:50:03 user nova-compute[73476]:   </features>
Aug 26 20:50:03 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:50:03 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:50:03 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:50:03 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:50:03 user nova-compute[73476]:   </clock>
Aug 26 20:50:03 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:50:03 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:50:03 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:50:03 user nova-compute[73476]:   </cpu>
Aug 26 20:50:03 user nova-compute[73476]:   <devices>
Aug 26 20:50:03 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:50:03 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:50:03 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk"/>
Aug 26 20:50:03 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:50:03 user nova-compute[73476]:     </disk>
Aug 26 20:50:03 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:50:03 user nova-compute[73476]:       <mac address="fa:16:3e:65:19:5d"/>
Aug 26 20:50:03 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:50:03 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:50:03 user nova-compute[73476]:       <target dev="tapbcb0b945-ae"/>
Aug 26 20:50:03 user nova-compute[73476]:     </interface>
Aug 26 20:50:03 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:50:03 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/console.log" append="off"/>
Aug 26 20:50:03 user nova-compute[73476]:     </serial>
Aug 26 20:50:03 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:50:03 user nova-compute[73476]:     <video>
Aug 26 20:50:03 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:50:03 user nova-compute[73476]:     </video>
Aug 26 20:50:03 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:50:03 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:50:03 user nova-compute[73476]:     </rng>
Aug 26 20:50:03 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:50:03 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:50:03 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:50:03 user nova-compute[73476]:     </memballoon>
Aug 26 20:50:03 user nova-compute[73476]:   </devices>
Aug 26 20:50:03 user nova-compute[73476]: </domain>
Aug 26 20:50:03 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-524100273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-524100273',id=23,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-5aa3cnzp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:50:01Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=1dddc689-a053-46d4-a29e-52c8fe78c76d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcb0b945-ae35-4b28-8629-d940710dd62b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb0b945-ae') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG os_vif [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcb0b945-ae35-4b28-8629-d940710dd62b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb0b945-ae') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcb0b945-ae, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcb0b945-ae, col_values=(('external_ids', {'iface-id': 'bcb0b945-ae35-4b28-8629-d940710dd62b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:19:5d', 'vm-uuid': '1dddc689-a053-46d4-a29e-52c8fe78c76d'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:50:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:03 user nova-compute[73476]: INFO os_vif [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcb0b945-ae35-4b28-8629-d940710dd62b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb0b945-ae')
Aug 26 20:50:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:50:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No VIF found with MAC fa:16:3e:65:19:5d, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:50:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-19f857d3-96e0-42ab-ae6f-4adde990f2d8 req-56ea5e33-8aca-4fd6-a762-995d7dfe1967 service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Updated VIF entry in instance network info cache for port bcb0b945-ae35-4b28-8629-d940710dd62b. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:50:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-19f857d3-96e0-42ab-ae6f-4adde990f2d8 req-56ea5e33-8aca-4fd6-a762-995d7dfe1967 service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Updating instance_info_cache with network_info: [{"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:50:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-19f857d3-96e0-42ab-ae6f-4adde990f2d8 req-56ea5e33-8aca-4fd6-a762-995d7dfe1967 service nova] Releasing lock "refresh_cache-1dddc689-a053-46d4-a29e-52c8fe78c76d" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:50:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-67ab0e73-fdcf-47ff-8bac-488c3470f97d req-ce6c2141-33e8-4a9b-9302-d74811ad6c6e service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received event network-vif-plugged-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-67ab0e73-fdcf-47ff-8bac-488c3470f97d req-ce6c2141-33e8-4a9b-9302-d74811ad6c6e service nova] Acquiring lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-67ab0e73-fdcf-47ff-8bac-488c3470f97d req-ce6c2141-33e8-4a9b-9302-d74811ad6c6e service nova] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-67ab0e73-fdcf-47ff-8bac-488c3470f97d req-ce6c2141-33e8-4a9b-9302-d74811ad6c6e service nova] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-67ab0e73-fdcf-47ff-8bac-488c3470f97d req-ce6c2141-33e8-4a9b-9302-d74811ad6c6e service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] No waiting events found dispatching network-vif-plugged-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:05 user nova-compute[73476]: WARNING nova.compute.manager [req-67ab0e73-fdcf-47ff-8bac-488c3470f97d req-ce6c2141-33e8-4a9b-9302-d74811ad6c6e service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received unexpected event network-vif-plugged-bcb0b945-ae35-4b28-8629-d940710dd62b for instance with vm_state building and task_state spawning.
Aug 26 20:50:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:50:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Creating image(s)
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Ensure instance console log exists: /opt/stack/data/nova/instances/6de9ed93-5d15-49cc-82fd-f4822fae54af/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Start _get_guest_xml network_info=[{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'be0aea59-31d4-455f-a3cc-eef55d5d15c9', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYQgzvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6de9ed93-5d15-49cc-82fd-f4822fae54af', 'attached_at': '', 'detached_at': '', 'volume_id': '3538703d-e8cc-4ed6-a7ea-a4377639b36b', 'serial': '3538703d-e8cc-4ed6-a7ea-a4377639b36b'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:50:06 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:50:06 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYQgzvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:50:06 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:50:06 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:50:06 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c42843-ce7f-4ec2-92a8-c05a119f7b57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:50:06 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dfff93-a231-442b-aa65-5281e49b77cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b] added
Aug 26 20:50:06 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe27b425-8bbc-4731-894a-c58fd2c31cf8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da393db-1dd8-4117-868f-c816e7eebe1b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HYQgzvbJ {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HYQgzvbJ" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d279a53d-8d18-4193-b306-ebbea8d7059f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HYQgzvbJ'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6317379f-6078-4700-ade8-24f5be908892]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[851eaafb-1738-48e9-bb1d-4dfcb135335f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabd2ed6-6f26-4ba4-94c4-73820060e143]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260]
Aug 26 20:50:06 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260] successful.
Aug 26 20:50:06 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb9894f-4990-47ac-86ab-2d18ec375bcf]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4738f1c9-ec2b-40f3-bb11-5a579bc44536]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:06 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:06 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:06 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[092e9591-1363-4b4a-a1da-5847cc2d7f5b]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:06 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYQgzvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23031326335373465', 'path': '/dev/sde'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031326335373465', 'path': '/dev/sde'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1052320475',display_name='tempest-TestShelveInstance-server-1052320475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1052320475',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9cneXgwenfoYbuZN8VdIjbq4P2M0guz+16jiyOigb8AgEqLxTm4bpfx8QdV/+zvdA3MHfUK2i4KW0nXA6NtKFaCQ0eZGPQQtLl65fp1vrWGC50VSojhGKAJ/OwKPFgOA==',key_name='tempest-TestShelveInstance-1851856693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6d618e1c9c4d42bb6572b5dcc2596a',ramdisk_id='',reservation_id='r-h4v8vnt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1238211530',owner_user_name='tempest-TestShelveInstance-1238211530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:49:52Z,user_data=None,user_id='c28d237e1730497f9b425a1b9bb1aaf5',uuid=6de9ed93-5d15-49cc-82fd-f4822fae54af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converting VIF {"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lazy-loading 'pci_devices' on Instance uuid 6de9ed93-5d15-49cc-82fd-f4822fae54af {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:50:07 user nova-compute[73476]:   <uuid>6de9ed93-5d15-49cc-82fd-f4822fae54af</uuid>
Aug 26 20:50:07 user nova-compute[73476]:   <name>instance-00000016</name>
Aug 26 20:50:07 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:50:07 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:50:07 user nova-compute[73476]:   <metadata>
Aug 26 20:50:07 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:50:07 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:50:07 user nova-compute[73476]:       <nova:name>tempest-TestShelveInstance-server-1052320475</nova:name>
Aug 26 20:50:07 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:50:06</nova:creationTime>
Aug 26 20:50:07 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:50:07 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:50:07 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:50:07 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:50:07 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:50:07 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:50:07 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:50:07 user nova-compute[73476]:       <nova:owner>
Aug 26 20:50:07 user nova-compute[73476]:         <nova:user uuid="c28d237e1730497f9b425a1b9bb1aaf5">tempest-TestShelveInstance-1238211530-project-member</nova:user>
Aug 26 20:50:07 user nova-compute[73476]:         <nova:project uuid="8f6d618e1c9c4d42bb6572b5dcc2596a">tempest-TestShelveInstance-1238211530</nova:project>
Aug 26 20:50:07 user nova-compute[73476]:       </nova:owner>
Aug 26 20:50:07 user nova-compute[73476]:       <nova:ports>
Aug 26 20:50:07 user nova-compute[73476]:         <nova:port uuid="d1598316-d7b5-4f58-947f-bee401d27b41">
Aug 26 20:50:07 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 20:50:07 user nova-compute[73476]:         </nova:port>
Aug 26 20:50:07 user nova-compute[73476]:       </nova:ports>
Aug 26 20:50:07 user nova-compute[73476]:     </nova:instance>
Aug 26 20:50:07 user nova-compute[73476]:   </metadata>
Aug 26 20:50:07 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:50:07 user nova-compute[73476]:     <system>
Aug 26 20:50:07 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:50:07 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:50:07 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:50:07 user nova-compute[73476]:       <entry name="serial">6de9ed93-5d15-49cc-82fd-f4822fae54af</entry>
Aug 26 20:50:07 user nova-compute[73476]:       <entry name="uuid">6de9ed93-5d15-49cc-82fd-f4822fae54af</entry>
Aug 26 20:50:07 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:50:07 user nova-compute[73476]:     </system>
Aug 26 20:50:07 user nova-compute[73476]:   </sysinfo>
Aug 26 20:50:07 user nova-compute[73476]:   <os>
Aug 26 20:50:07 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:50:07 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:50:07 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:50:07 user nova-compute[73476]:   </os>
Aug 26 20:50:07 user nova-compute[73476]:   <features>
Aug 26 20:50:07 user nova-compute[73476]:     <acpi/>
Aug 26 20:50:07 user nova-compute[73476]:     <apic/>
Aug 26 20:50:07 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:50:07 user nova-compute[73476]:   </features>
Aug 26 20:50:07 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:50:07 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:50:07 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:50:07 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:50:07 user nova-compute[73476]:   </clock>
Aug 26 20:50:07 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:50:07 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:50:07 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:50:07 user nova-compute[73476]:   </cpu>
Aug 26 20:50:07 user nova-compute[73476]:   <devices>
Aug 26 20:50:07 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:50:07 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:50:07 user nova-compute[73476]:       <source dev="/dev/sde"/>
Aug 26 20:50:07 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:50:07 user nova-compute[73476]:       <serial>3538703d-e8cc-4ed6-a7ea-a4377639b36b</serial>
Aug 26 20:50:07 user nova-compute[73476]:     </disk>
Aug 26 20:50:07 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:50:07 user nova-compute[73476]:       <mac address="fa:16:3e:b7:fa:1f"/>
Aug 26 20:50:07 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:50:07 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:50:07 user nova-compute[73476]:       <target dev="tapd1598316-d7"/>
Aug 26 20:50:07 user nova-compute[73476]:     </interface>
Aug 26 20:50:07 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:50:07 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/6de9ed93-5d15-49cc-82fd-f4822fae54af/console.log" append="off"/>
Aug 26 20:50:07 user nova-compute[73476]:     </serial>
Aug 26 20:50:07 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:50:07 user nova-compute[73476]:     <video>
Aug 26 20:50:07 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:50:07 user nova-compute[73476]:     </video>
Aug 26 20:50:07 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:50:07 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:50:07 user nova-compute[73476]:     </rng>
Aug 26 20:50:07 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:50:07 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:50:07 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:50:07 user nova-compute[73476]:     </memballoon>
Aug 26 20:50:07 user nova-compute[73476]:   </devices>
Aug 26 20:50:07 user nova-compute[73476]: </domain>
Aug 26 20:50:07 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1052320475',display_name='tempest-TestShelveInstance-server-1052320475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1052320475',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9cneXgwenfoYbuZN8VdIjbq4P2M0guz+16jiyOigb8AgEqLxTm4bpfx8QdV/+zvdA3MHfUK2i4KW0nXA6NtKFaCQ0eZGPQQtLl65fp1vrWGC50VSojhGKAJ/OwKPFgOA==',key_name='tempest-TestShelveInstance-1851856693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6d618e1c9c4d42bb6572b5dcc2596a',ramdisk_id='',reservation_id='r-h4v8vnt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1238211530',owner_user_name='tempest-TestShelveInstance-1238211530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:49:52Z,user_data=None,user_id='c28d237e1730497f9b425a1b9bb1aaf5',uuid=6de9ed93-5d15-49cc-82fd-f4822fae54af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converting VIF {"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG os_vif [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1598316-d7, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1598316-d7, col_values=(('external_ids', {'iface-id': 'd1598316-d7b5-4f58-947f-bee401d27b41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:fa:1f', 'vm-uuid': '6de9ed93-5d15-49cc-82fd-f4822fae54af'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:07 user nova-compute[73476]: INFO os_vif [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7')
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] No VIF found with MAC fa:16:3e:b7:fa:1f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083007.9275045, 1dddc689-a053-46d4-a29e-52c8fe78c76d => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:07 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] VM Resumed (Lifecycle Event)
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-16fe80fe-c501-4458-9fd2-bbb3ed22818d req-1931ead4-89b9-4334-a1bd-1e033ac0f94b service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received event network-vif-plugged-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-16fe80fe-c501-4458-9fd2-bbb3ed22818d req-1931ead4-89b9-4334-a1bd-1e033ac0f94b service nova] Acquiring lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-16fe80fe-c501-4458-9fd2-bbb3ed22818d req-1931ead4-89b9-4334-a1bd-1e033ac0f94b service nova] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-16fe80fe-c501-4458-9fd2-bbb3ed22818d req-1931ead4-89b9-4334-a1bd-1e033ac0f94b service nova] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-16fe80fe-c501-4458-9fd2-bbb3ed22818d req-1931ead4-89b9-4334-a1bd-1e033ac0f94b service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] No waiting events found dispatching network-vif-plugged-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:07 user nova-compute[73476]: WARNING nova.compute.manager [req-16fe80fe-c501-4458-9fd2-bbb3ed22818d req-1931ead4-89b9-4334-a1bd-1e033ac0f94b service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received unexpected event network-vif-plugged-bcb0b945-ae35-4b28-8629-d940710dd62b for instance with vm_state building and task_state spawning.
Aug 26 20:50:07 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Instance spawned successfully.
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:07 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:50:07 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083007.9278648, 1dddc689-a053-46d4-a29e-52c8fe78c76d => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:08 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] VM Started (Lifecycle Event)
Aug 26 20:50:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:50:08 user nova-compute[73476]: INFO nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 26 20:50:08 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:08 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:50:08 user nova-compute[73476]: INFO nova.compute.manager [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Took 7.58 seconds to build instance.
Aug 26 20:50:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0acc1938-5d6e-4e88-b8da-52e17bd3aaff tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.679s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-3d0b4a24-58a0-4e16-a4b1-43128783b311 req-b409e328-3610-4a57-af82-f120589e61ed service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3d0b4a24-58a0-4e16-a4b1-43128783b311 req-b409e328-3610-4a57-af82-f120589e61ed service nova] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3d0b4a24-58a0-4e16-a4b1-43128783b311 req-b409e328-3610-4a57-af82-f120589e61ed service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3d0b4a24-58a0-4e16-a4b1-43128783b311 req-b409e328-3610-4a57-af82-f120589e61ed service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-3d0b4a24-58a0-4e16-a4b1-43128783b311 req-b409e328-3610-4a57-af82-f120589e61ed service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] No waiting events found dispatching network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:09 user nova-compute[73476]: WARNING nova.compute.manager [req-3d0b4a24-58a0-4e16-a4b1-43128783b311 req-b409e328-3610-4a57-af82-f120589e61ed service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received unexpected event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 for instance with vm_state building and task_state spawning.
Aug 26 20:50:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-a654cd53-f110-45f7-88f0-85c9571ad547 req-c61fc395-a8fd-4bfa-8cea-a7c0bee9a651 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a654cd53-f110-45f7-88f0-85c9571ad547 req-c61fc395-a8fd-4bfa-8cea-a7c0bee9a651 service nova] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a654cd53-f110-45f7-88f0-85c9571ad547 req-c61fc395-a8fd-4bfa-8cea-a7c0bee9a651 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a654cd53-f110-45f7-88f0-85c9571ad547 req-c61fc395-a8fd-4bfa-8cea-a7c0bee9a651 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-a654cd53-f110-45f7-88f0-85c9571ad547 req-c61fc395-a8fd-4bfa-8cea-a7c0bee9a651 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] No waiting events found dispatching network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:11 user nova-compute[73476]: WARNING nova.compute.manager [req-a654cd53-f110-45f7-88f0-85c9571ad547 req-c61fc395-a8fd-4bfa-8cea-a7c0bee9a651 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received unexpected event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 for instance with vm_state building and task_state spawning.
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693082996.775367, ba24bae1-d608-41dd-b928-fad3ba415cc1 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:11 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] VM Stopped (Lifecycle Event)
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-a18a1071-b193-4326-81a8-c5cc42e59862 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083011.8405244, 6de9ed93-5d15-49cc-82fd-f4822fae54af => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:11 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] VM Resumed (Lifecycle Event)
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:50:11 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Instance spawned successfully.
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:11 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083011.8444662, 6de9ed93-5d15-49cc-82fd-f4822fae54af => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:11 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] VM Started (Lifecycle Event)
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:50:11 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:50:11 user nova-compute[73476]: INFO nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 26 20:50:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:12 user nova-compute[73476]: INFO nova.compute.manager [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Took 21.05 seconds to build instance.
Aug 26 20:50:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4e03bb32-6fac-45ef-bd34-b1e54aef9e29 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.151s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:50:14 user nova-compute[73476]: INFO nova.compute.claims [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Claim successful on node user
Aug 26 20:50:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:14 user nova-compute[73476]: DEBUG nova.objects.instance [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lazy-loading 'flavor' on Instance uuid 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.768s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG nova.network.neutron [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:50:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:50:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:15 user nova-compute[73476]: INFO nova.compute.manager [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Attaching volume d48e23ca-ed8d-49fd-b6db-8c2eefd3025d to /dev/vdb
Aug 26 20:50:15 user nova-compute[73476]: DEBUG nova.policy [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb63707c9d734bf5b1d1bb20162e3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c713d9f0cc5f4dd7a8629ba1b27e72f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG os_brick.utils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:50:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Creating image(s)
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4396c84e-00c8-4079-b431-c40967a4011d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[894adb31-76d2-4fd0-8910-91e4a62706d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[028ed641-a398-40e5-bde3-107e705a857f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665275f-002f-45ce-afe5-b00e5b81864e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:50:15 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a55f5-de1e-474e-9428-08f462ca3c1f]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG os_brick.utils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] <== get_connector_properties: return (301ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Updating existing volume attachment record: ecfd10c6-de4b-4bb4-96b0-86b6bea69f9f {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk 1073741824" returned: 0 in 0.053s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.263s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG nova.network.neutron [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Successfully created port: 3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Cannot resize image /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Ensure instance console log exists: /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Successfully updated port: 3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquired lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-05b9e336-2d2e-4feb-9c02-445916a449e2 req-6b473a73-5c64-4e69-a347-39e57105cf9e service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-changed-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-05b9e336-2d2e-4feb-9c02-445916a449e2 req-6b473a73-5c64-4e69-a347-39e57105cf9e service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Refreshing instance network info cache due to event network-changed-3c33176d-b04b-4fcd-9e30-e2b9799af0c4. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-05b9e336-2d2e-4feb-9c02-445916a449e2 req-6b473a73-5c64-4e69-a347-39e57105cf9e service nova] Acquiring lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating instance_info_cache with network_info: [{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Releasing lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Instance network_info: |[{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-05b9e336-2d2e-4feb-9c02-445916a449e2 req-6b473a73-5c64-4e69-a347-39e57105cf9e service nova] Acquired lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.network.neutron [req-05b9e336-2d2e-4feb-9c02-445916a449e2 req-6b473a73-5c64-4e69-a347-39e57105cf9e service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Refreshing network info cache for port 3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Start _get_guest_xml network_info=[{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:50:17 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:50:17 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-498578521',display_name='tempest-ServerRescueNegativeTestJSON-server-498578521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-498578521',id=24,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrYc/eo42C+qeHxgT+p6TK6jOtky3Pkwr7yvC+k8KAA3Fdpx5iwJgpsdD1am7zb+G0Wb0G2AiVReR/rWqcojnZEmPVzWbjoLQ2gzQtDRr1lW7FV6rEkvFmKMKX03TRu1g==',key_name='tempest-keypair-113143643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-63tr0wlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:50:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=ed515d2d-7ad6-48bb-b353-abc4e620156c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=3c33176d-b04b-4fcd-9e30-e2b9799af0c4,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33176d-b0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'pci_devices' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:50:17 user nova-compute[73476]:   <uuid>ed515d2d-7ad6-48bb-b353-abc4e620156c</uuid>
Aug 26 20:50:17 user nova-compute[73476]:   <name>instance-00000018</name>
Aug 26 20:50:17 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:50:17 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:50:17 user nova-compute[73476]:   <metadata>
Aug 26 20:50:17 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:50:17 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:50:17 user nova-compute[73476]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-498578521</nova:name>
Aug 26 20:50:17 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:50:17</nova:creationTime>
Aug 26 20:50:17 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:50:17 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:50:17 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:50:17 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:50:17 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:50:17 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:50:17 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:50:17 user nova-compute[73476]:       <nova:owner>
Aug 26 20:50:17 user nova-compute[73476]:         <nova:user uuid="eb63707c9d734bf5b1d1bb20162e3204">tempest-ServerRescueNegativeTestJSON-552908196-project-member</nova:user>
Aug 26 20:50:17 user nova-compute[73476]:         <nova:project uuid="c713d9f0cc5f4dd7a8629ba1b27e72f0">tempest-ServerRescueNegativeTestJSON-552908196</nova:project>
Aug 26 20:50:17 user nova-compute[73476]:       </nova:owner>
Aug 26 20:50:17 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:50:17 user nova-compute[73476]:       <nova:ports>
Aug 26 20:50:17 user nova-compute[73476]:         <nova:port uuid="3c33176d-b04b-4fcd-9e30-e2b9799af0c4">
Aug 26 20:50:17 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 20:50:17 user nova-compute[73476]:         </nova:port>
Aug 26 20:50:17 user nova-compute[73476]:       </nova:ports>
Aug 26 20:50:17 user nova-compute[73476]:     </nova:instance>
Aug 26 20:50:17 user nova-compute[73476]:   </metadata>
Aug 26 20:50:17 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:50:17 user nova-compute[73476]:     <system>
Aug 26 20:50:17 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:50:17 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:50:17 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:50:17 user nova-compute[73476]:       <entry name="serial">ed515d2d-7ad6-48bb-b353-abc4e620156c</entry>
Aug 26 20:50:17 user nova-compute[73476]:       <entry name="uuid">ed515d2d-7ad6-48bb-b353-abc4e620156c</entry>
Aug 26 20:50:17 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:50:17 user nova-compute[73476]:     </system>
Aug 26 20:50:17 user nova-compute[73476]:   </sysinfo>
Aug 26 20:50:17 user nova-compute[73476]:   <os>
Aug 26 20:50:17 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:50:17 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:50:17 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:50:17 user nova-compute[73476]:   </os>
Aug 26 20:50:17 user nova-compute[73476]:   <features>
Aug 26 20:50:17 user nova-compute[73476]:     <acpi/>
Aug 26 20:50:17 user nova-compute[73476]:     <apic/>
Aug 26 20:50:17 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:50:17 user nova-compute[73476]:   </features>
Aug 26 20:50:17 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:50:17 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:50:17 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:50:17 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:50:17 user nova-compute[73476]:   </clock>
Aug 26 20:50:17 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:50:17 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:50:17 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:50:17 user nova-compute[73476]:   </cpu>
Aug 26 20:50:17 user nova-compute[73476]:   <devices>
Aug 26 20:50:17 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:50:17 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:50:17 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk"/>
Aug 26 20:50:17 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:50:17 user nova-compute[73476]:     </disk>
Aug 26 20:50:17 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:50:17 user nova-compute[73476]:       <mac address="fa:16:3e:df:c4:5d"/>
Aug 26 20:50:17 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:50:17 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:50:17 user nova-compute[73476]:       <target dev="tap3c33176d-b0"/>
Aug 26 20:50:17 user nova-compute[73476]:     </interface>
Aug 26 20:50:17 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:50:17 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/console.log" append="off"/>
Aug 26 20:50:17 user nova-compute[73476]:     </serial>
Aug 26 20:50:17 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:50:17 user nova-compute[73476]:     <video>
Aug 26 20:50:17 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:50:17 user nova-compute[73476]:     </video>
Aug 26 20:50:17 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:50:17 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:50:17 user nova-compute[73476]:     </rng>
Aug 26 20:50:17 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:50:17 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:50:17 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:50:17 user nova-compute[73476]:     </memballoon>
Aug 26 20:50:17 user nova-compute[73476]:   </devices>
Aug 26 20:50:17 user nova-compute[73476]: </domain>
Aug 26 20:50:17 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-498578521',display_name='tempest-ServerRescueNegativeTestJSON-server-498578521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-498578521',id=24,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrYc/eo42C+qeHxgT+p6TK6jOtky3Pkwr7yvC+k8KAA3Fdpx5iwJgpsdD1am7zb+G0Wb0G2AiVReR/rWqcojnZEmPVzWbjoLQ2gzQtDRr1lW7FV6rEkvFmKMKX03TRu1g==',key_name='tempest-keypair-113143643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-63tr0wlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:50:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=ed515d2d-7ad6-48bb-b353-abc4e620156c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=3c33176d-b04b-4fcd-9e30-e2b9799af0c4,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33176d-b0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG os_vif [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=3c33176d-b04b-4fcd-9e30-e2b9799af0c4,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33176d-b0') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c33176d-b0, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c33176d-b0, col_values=(('external_ids', {'iface-id': '3c33176d-b04b-4fcd-9e30-e2b9799af0c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:c4:5d', 'vm-uuid': 'ed515d2d-7ad6-48bb-b353-abc4e620156c'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:50:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:17 user nova-compute[73476]: INFO os_vif [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=3c33176d-b04b-4fcd-9e30-e2b9799af0c4,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33176d-b0')
Aug 26 20:50:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:50:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No VIF found with MAC fa:16:3e:df:c4:5d, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:50:18 user nova-compute[73476]: DEBUG nova.network.neutron [req-05b9e336-2d2e-4feb-9c02-445916a449e2 req-6b473a73-5c64-4e69-a347-39e57105cf9e service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updated VIF entry in instance network info cache for port 3c33176d-b04b-4fcd-9e30-e2b9799af0c4. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:50:18 user nova-compute[73476]: DEBUG nova.network.neutron [req-05b9e336-2d2e-4feb-9c02-445916a449e2 req-6b473a73-5c64-4e69-a347-39e57105cf9e service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating instance_info_cache with network_info: [{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:50:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-05b9e336-2d2e-4feb-9c02-445916a449e2 req-6b473a73-5c64-4e69-a347-39e57105cf9e service nova] Releasing lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:50:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-d19c64cb-cd78-4b95-9d27-83aaf22d3d99 req-769ca570-ccaf-43ba-a8c6-6b742e1623da service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d19c64cb-cd78-4b95-9d27-83aaf22d3d99 req-769ca570-ccaf-43ba-a8c6-6b742e1623da service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d19c64cb-cd78-4b95-9d27-83aaf22d3d99 req-769ca570-ccaf-43ba-a8c6-6b742e1623da service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d19c64cb-cd78-4b95-9d27-83aaf22d3d99 req-769ca570-ccaf-43ba-a8c6-6b742e1623da service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-d19c64cb-cd78-4b95-9d27-83aaf22d3d99 req-769ca570-ccaf-43ba-a8c6-6b742e1623da service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:20 user nova-compute[73476]: WARNING nova.compute.manager [req-d19c64cb-cd78-4b95-9d27-83aaf22d3d99 req-769ca570-ccaf-43ba-a8c6-6b742e1623da service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state building and task_state spawning.
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4209cd0-9086-4a3e-9fcf-b142d7fc009a req-e365515f-1ec2-4b29-b7bd-af17a389e55d service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4209cd0-9086-4a3e-9fcf-b142d7fc009a req-e365515f-1ec2-4b29-b7bd-af17a389e55d service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4209cd0-9086-4a3e-9fcf-b142d7fc009a req-e365515f-1ec2-4b29-b7bd-af17a389e55d service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4209cd0-9086-4a3e-9fcf-b142d7fc009a req-e365515f-1ec2-4b29-b7bd-af17a389e55d service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4209cd0-9086-4a3e-9fcf-b142d7fc009a req-e365515f-1ec2-4b29-b7bd-af17a389e55d service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:22 user nova-compute[73476]: WARNING nova.compute.manager [req-f4209cd0-9086-4a3e-9fcf-b142d7fc009a req-e365515f-1ec2-4b29-b7bd-af17a389e55d service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state building and task_state spawning.
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083022.4804177, ed515d2d-7ad6-48bb-b353-abc4e620156c => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:22 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] VM Resumed (Lifecycle Event)
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:50:22 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Instance spawned successfully.
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:22 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083022.4814434, ed515d2d-7ad6-48bb-b353-abc4e620156c => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:22 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] VM Started (Lifecycle Event)
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:50:22 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:50:22 user nova-compute[73476]: INFO nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Took 7.23 seconds to spawn the instance on the hypervisor.
Aug 26 20:50:22 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:22 user nova-compute[73476]: INFO nova.compute.manager [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Took 8.45 seconds to build instance.
Aug 26 20:50:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a70c158-2eb9-418d-9aa5-bba2fac33474 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.564s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:24 user nova-compute[73476]: INFO nova.compute.manager [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Detaching volume 241e27f5-1d23-4802-9866-3f66f16c0fbc
Aug 26 20:50:24 user nova-compute[73476]: INFO nova.virt.block_device [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Attempting to driver detach volume 241e27f5-1d23-4802-9866-3f66f16c0fbc from mountpoint /dev/vdb
Aug 26 20:50:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Attempting to detach device vdb from instance eaf9f058-2194-4e0e-9460-328108758c42 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:50:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:50:24 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:50:24 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 20:50:24 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:50:24 user nova-compute[73476]:   <serial>241e27f5-1d23-4802-9866-3f66f16c0fbc</serial>
Aug 26 20:50:24 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 20:50:24 user nova-compute[73476]: </disk>
Aug 26 20:50:24 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:50:24 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully detached device vdb from instance eaf9f058-2194-4e0e-9460-328108758c42 from the persistent domain config.
Aug 26 20:50:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eaf9f058-2194-4e0e-9460-328108758c42 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:50:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:50:24 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:50:24 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 20:50:24 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:50:24 user nova-compute[73476]:   <serial>241e27f5-1d23-4802-9866-3f66f16c0fbc</serial>
Aug 26 20:50:24 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 20:50:24 user nova-compute[73476]: </disk>
Aug 26 20:50:24 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:50:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083025.2457356, eaf9f058-2194-4e0e-9460-328108758c42 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eaf9f058-2194-4e0e-9460-328108758c42 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:50:25 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully detached device vdb from instance eaf9f058-2194-4e0e-9460-328108758c42 from the live domain config.
Aug 26 20:50:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtUBXPfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:50:25 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c394022-1c1f-4fa3-b4ba-3676d7e5d6d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd83342a-6ae3-4ef5-95f2-1c8ca0580b32]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:25 user nova-compute[73476]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:50:25 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258cf30550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d8074-e544-48fb-bd77-5e1ead64d96b]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[226cef44-2437-4328-b3b3-0ef73e45705f]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[174682eb-9b07-4480-a2b1-a893d3423cfa]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dc3fcc-9492-43ac-9df7-63500b24d240]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[308f5b4e-ef30-44c1-8cad-1374be566002]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2033bb9-6729-46f3-b28a-5688d55ddb04]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260]
Aug 26 20:50:25 user nova-compute[73476]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc, portal: 172.16.0.220,3260] successful.
Aug 26 20:50:25 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241e27f5-1d23-4802-9866-3f66f16c0fbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f78bc3-6057-43f2-84f5-b02b69319565]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== disconnect_volume: return (414ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:50:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:50:26 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'flavor' on Instance uuid eaf9f058-2194-4e0e-9460-328108758c42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:50:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4c259ac1-5abd-4d98-addf-de6e6d535de5 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.117s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:26 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:50:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:50:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:27 user nova-compute[73476]: INFO nova.compute.manager [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Terminating instance
Aug 26 20:50:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:50:27 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:50:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-bb7c37e1-665a-4c31-88b2-8739839c2e98 req-8713b4ec-cd23-43c1-ba83-233e042b7017 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-unplugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bb7c37e1-665a-4c31-88b2-8739839c2e98 req-8713b4ec-cd23-43c1-ba83-233e042b7017 service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bb7c37e1-665a-4c31-88b2-8739839c2e98 req-8713b4ec-cd23-43c1-ba83-233e042b7017 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bb7c37e1-665a-4c31-88b2-8739839c2e98 req-8713b4ec-cd23-43c1-ba83-233e042b7017 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-bb7c37e1-665a-4c31-88b2-8739839c2e98 req-8713b4ec-cd23-43c1-ba83-233e042b7017 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-unplugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-bb7c37e1-665a-4c31-88b2-8739839c2e98 req-8713b4ec-cd23-43c1-ba83-233e042b7017 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-unplugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:50:28 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Instance destroyed successfully.
Aug 26 20:50:28 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lazy-loading 'resources' on Instance uuid ad42cf47-42fb-488f-a44f-cf9824dd4d99 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-263678955',display_name='tempest-ServerActionsTestOtherB-server-263678955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-263678955',id=5,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6duovOgpoS/+TE0EH/fCNy+ilV5kxrulfvMaTJVTAkoOJVt3B0olv0pH7NT01fhQF+CMU3wUX3bGKgX/wKj8M/GNeOdqt2EwZ91VfdEmDAANieG8njlOp1SAEmAi7Ug==',key_name='tempest-keypair-1212818177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:48:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76a9f74cd94849f7a132c168b1ed5622',ramdisk_id='',reservation_id='r-ns6go6pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-42689020',owner_user_name='tempest-ServerActionsTestOtherB-42689020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18713e0a843f45f08cdb8d70e7cafeeb',uuid=ad42cf47-42fb-488f-a44f-cf9824dd4d99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converting VIF {"id": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "address": "fa:16:3e:65:28:58", "network": {"id": "3225a91c-2a03-4792-80f0-15cdc6bca26d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-111688451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a9f74cd94849f7a132c168b1ed5622", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b59e8a-19", "ovs_interfaceid": "f0b59e8a-1964-4699-81f4-6a9c3b08dae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG os_vif [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0b59e8a-19, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:50:28 user nova-compute[73476]: INFO os_vif [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:28:58,bridge_name='br-int',has_traffic_filtering=True,id=f0b59e8a-1964-4699-81f4-6a9c3b08dae0,network=Network(3225a91c-2a03-4792-80f0-15cdc6bca26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b59e8a-19')
Aug 26 20:50:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDcINFvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:50:28 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:50:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[783066af-219f-4cdc-8085-3aa3960e5fda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3544641f-b528-49e4-a40f-19a6b1b92cb9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:28 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d040a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43bfc51-66d6-47bd-814f-60c4ee1508d9]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b66a31-7279-4a89-a670-757468a105da]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b7499c-1c10-487f-ab76-03924794fcf9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb7e7bc-cef9-494d-9417-fc38b157eed6]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c2aaab-d5b9-4409-a3fe-8b1ac6732349]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-6202ef00-1391-4927-90b7-058d1486f6f5 req-9137c9d4-d3a3-4e4f-916e-9e7e6a13c0e7 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event volume-reimaged-60eef670-6c83-45f8-85af-dc163f4ed233 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6202ef00-1391-4927-90b7-058d1486f6f5 req-9137c9d4-d3a3-4e4f-916e-9e7e6a13c0e7 service nova] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6202ef00-1391-4927-90b7-058d1486f6f5 req-9137c9d4-d3a3-4e4f-916e-9e7e6a13c0e7 service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6202ef00-1391-4927-90b7-058d1486f6f5 req-9137c9d4-d3a3-4e4f-916e-9e7e6a13c0e7 service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-6202ef00-1391-4927-90b7-058d1486f6f5 req-9137c9d4-d3a3-4e4f-916e-9e7e6a13c0e7 service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Processing event volume-reimaged-60eef670-6c83-45f8-85af-dc163f4ed233 {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance event wait completed in 30 seconds for volume-reimaged {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25fd571-2b33-46ca-8fa0-89fd0b91b952]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260]
Aug 26 20:50:29 user nova-compute[73476]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2, portal: 172.16.0.220,3260] successful.
Aug 26 20:50:29 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: INFO nova.virt.block_device [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Booting with volume 60eef670-6c83-45f8-85af-dc163f4ed233 at /dev/vda
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf272c00-ebf4-4bcd-a55c-937cfee80247]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] <== disconnect_volume: return (365ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:50:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Deleting instance files /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99_del
Aug 26 20:50:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Deletion of /opt/stack/data/nova/instances/ad42cf47-42fb-488f-a44f-cf9824dd4d99_del complete
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.utils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14b31c8-f38b-46fa-b45a-f641196efde8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[764dbed4-6205-4981-a605-a49056d97e75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: INFO nova.compute.manager [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Took 1.93 seconds to destroy the instance on the hypervisor.
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2084319f-ff8a-44af-8af5-3514ba20aeef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3e228b-8f4f-439f-add6-fdc4ad24f7a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:50:29 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:50:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0c5a94-e979-4d77-bcc0-8c18611ec84b]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG os_brick.utils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Updating existing volume attachment record: 32716474-ddc2-4240-9c9d-4224e1e7ee52 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:50:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:50:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-01d3b57a-13de-4701-aa84-ac6b72d0d1fc req-fa893e23-4d17-4356-aa4b-24cbdcc00cf6 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-01d3b57a-13de-4701-aa84-ac6b72d0d1fc req-fa893e23-4d17-4356-aa4b-24cbdcc00cf6 service nova] Acquiring lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-01d3b57a-13de-4701-aa84-ac6b72d0d1fc req-fa893e23-4d17-4356-aa4b-24cbdcc00cf6 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-01d3b57a-13de-4701-aa84-ac6b72d0d1fc req-fa893e23-4d17-4356-aa4b-24cbdcc00cf6 service nova] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-01d3b57a-13de-4701-aa84-ac6b72d0d1fc req-fa893e23-4d17-4356-aa4b-24cbdcc00cf6 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] No waiting events found dispatching network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:30 user nova-compute[73476]: WARNING nova.compute.manager [req-01d3b57a-13de-4701-aa84-ac6b72d0d1fc req-fa893e23-4d17-4356-aa4b-24cbdcc00cf6 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received unexpected event network-vif-plugged-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 for instance with vm_state active and task_state deleting.
Aug 26 20:50:31 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:50:31 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Took 1.68 seconds to deallocate network for instance.
Aug 26 20:50:31 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:50:31 user nova-compute[73476]: INFO nova.compute.manager [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Took 0.80 seconds to detach 1 volumes for instance.
Aug 26 20:50:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.volume.cinder [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Update attachment failed for attachment ecfd10c6-de4b-4bb4-96b0-86b6bea69f9f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 was not found.).). (HTTP 500) (Request-ID: req-2b1bab60-31f3-4791-a8dd-c298fd67ec6e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 was not found.).). (HTTP 500) (Request-ID: req-2b1bab60-31f3-4791-a8dd-c298fd67ec6e)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Failed to attach d48e23ca-ed8d-49fd-b6db-8c2eefd3025d at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 was not found.).). (HTTP 500) (Request-ID: req-2b1bab60-31f3-4791-a8dd-c298fd67ec6e)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Traceback (most recent call last):
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     ret_val = method(obj, context, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     self._do_attach(context, instance, volume, volume_api,
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     self._volume_attach(context, volume, connector, instance,
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     connection_info = volume_api.attachment_update(
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     res = method(self, ctx, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     with excutils.save_and_reraise_exception():
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     self.force_reraise()
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     raise self.value
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     return method.func(obj, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     resp = self._update('/attachments/%s' % id, body)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     return self.request(url, method, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9]     raise exceptions.from_response(resp, body)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 was not found.).). (HTTP 500) (Request-ID: req-2b1bab60-31f3-4791-a8dd-c298fd67ec6e)
Aug 26 20:50:32 user nova-compute[73476]: ERROR nova.compute.manager [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] 
Aug 26 20:50:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.018s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server [None req-deeed79c-b0a3-460e-ad49-66404d46437a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 was not found.).). (HTTP 500) (Request-ID: req-2b1bab60-31f3-4791-a8dd-c298fd67ec6e)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d48e23ca-ed8d-49fd-b6db-8c2eefd3025d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:8809a5b6-d0f3-4f59-b94e-220073f5f4c2 was not found.).). (HTTP 500) (Request-ID: req-2b1bab60-31f3-4791-a8dd-c298fd67ec6e)
Aug 26 20:50:32 user nova-compute[73476]: ERROR oslo_messaging.rpc.server 
Aug 26 20:50:32 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:50:32 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:50:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:32 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Deleted allocations for instance ad42cf47-42fb-488f-a44f-cf9824dd4d99
Aug 26 20:50:32 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:50:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1498582f-c75f-4909-bb2e-c9b3616707f9 tempest-ServerActionsTestOtherB-42689020 tempest-ServerActionsTestOtherB-42689020-project-member] Lock "ad42cf47-42fb-488f-a44f-cf9824dd4d99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.342s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:32 user nova-compute[73476]: DEBUG nova.compute.manager [req-f20d36f2-7870-4c3d-a8be-aafb4c05a1f3 req-c360b5b4-5d40-44cb-87d5-48a2d48c5035 service nova] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Received event network-vif-deleted-f0b59e8a-1964-4699-81f4-6a9c3b08dae0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:34 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:50:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:50:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-6dcba76a-1900-4157-ba3d-10a58114b327 req-ec44d10c-20f4-4f5e-8b3c-69dc39d12dd8 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-6dcba76a-1900-4157-ba3d-10a58114b327 req-ec44d10c-20f4-4f5e-8b3c-69dc39d12dd8 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing instance network info cache due to event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:50:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6dcba76a-1900-4157-ba3d-10a58114b327 req-ec44d10c-20f4-4f5e-8b3c-69dc39d12dd8 service nova] Acquiring lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:50:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6dcba76a-1900-4157-ba3d-10a58114b327 req-ec44d10c-20f4-4f5e-8b3c-69dc39d12dd8 service nova] Acquired lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:50:35 user nova-compute[73476]: DEBUG nova.network.neutron [req-6dcba76a-1900-4157-ba3d-10a58114b327 req-ec44d10c-20f4-4f5e-8b3c-69dc39d12dd8 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG nova.network.neutron [req-6dcba76a-1900-4157-ba3d-10a58114b327 req-ec44d10c-20f4-4f5e-8b3c-69dc39d12dd8 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updated VIF entry in instance network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG nova.network.neutron [req-6dcba76a-1900-4157-ba3d-10a58114b327 req-ec44d10c-20f4-4f5e-8b3c-69dc39d12dd8 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updating instance_info_cache with network_info: [{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6dcba76a-1900-4157-ba3d-10a58114b327 req-ec44d10c-20f4-4f5e-8b3c-69dc39d12dd8 service nova] Releasing lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:36 user nova-compute[73476]: INFO nova.compute.manager [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Detaching volume 971018e8-7d57-466a-a4cf-51465d1beabc
Aug 26 20:50:37 user nova-compute[73476]: INFO nova.virt.block_device [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Attempting to driver detach volume 971018e8-7d57-466a-a4cf-51465d1beabc from mountpoint /dev/vdb
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Attempting to detach device vdb from instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:50:37 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:50:37 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 20:50:37 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:50:37 user nova-compute[73476]:   <serial>971018e8-7d57-466a-a4cf-51465d1beabc</serial>
Aug 26 20:50:37 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 20:50:37 user nova-compute[73476]: </disk>
Aug 26 20:50:37 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:50:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully detached device vdb from instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b from the persistent domain config.
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:50:37 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:50:37 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 20:50:37 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:50:37 user nova-compute[73476]:   <serial>971018e8-7d57-466a-a4cf-51465d1beabc</serial>
Aug 26 20:50:37 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 20:50:37 user nova-compute[73476]: </disk>
Aug 26 20:50:37 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083037.7077482, 7f2e574f-a47c-45dc-9261-14de64d5ac7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:50:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully detached device vdb from instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b from the live domain config.
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMloprsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:50:37 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0d2f12-1c5d-4c4c-ae85-826ca20b45d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-646daefd-8d99-4a79-a15c-8f46a605fc90 req-a395bf0e-5080-48e5-a500-e563e5a12786 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-646daefd-8d99-4a79-a15c-8f46a605fc90 req-a395bf0e-5080-48e5-a500-e563e5a12786 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing instance network info cache due to event network-changed-31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-646daefd-8d99-4a79-a15c-8f46a605fc90 req-a395bf0e-5080-48e5-a500-e563e5a12786 service nova] Acquiring lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-646daefd-8d99-4a79-a15c-8f46a605fc90 req-a395bf0e-5080-48e5-a500-e563e5a12786 service nova] Acquired lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG nova.network.neutron [req-646daefd-8d99-4a79-a15c-8f46a605fc90 req-a395bf0e-5080-48e5-a500-e563e5a12786 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Refreshing network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6873672a-0df7-4fa4-93f3-69f61e0081f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:37 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:37 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:37 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258cf31f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc'): ({'sdd'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Removing single pathed devices sdd {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e088241d-948c-470e-9284-79a06814c9bc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae01271-ebf8-4884-9a69-ad0bfb5f2778]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Flushing IO for device /dev/sdd {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f947b04-572f-43fc-a829-92c0985edb10]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a2a8c2-9124-4c28-b695-340bc8119f85]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5adbba-9359-43e6-aa9b-e7e998f3200b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f01dd-5841-4448-8a53-80968243c59b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260]
Aug 26 20:50:38 user nova-compute[73476]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc, portal: 172.16.0.220,3260] successful.
Aug 26 20:50:38 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:971018e8-7d57-466a-a4cf-51465d1beabc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b63edfd-185e-45d6-9585-0e9fbae68d49]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] <== disconnect_volume: return (410ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG nova.network.neutron [req-646daefd-8d99-4a79-a15c-8f46a605fc90 req-a395bf0e-5080-48e5-a500-e563e5a12786 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updated VIF entry in instance network info cache for port 31732c2a-94a0-4be3-b5f5-fbb1488b7161. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG nova.network.neutron [req-646daefd-8d99-4a79-a15c-8f46a605fc90 req-a395bf0e-5080-48e5-a500-e563e5a12786 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updating instance_info_cache with network_info: [{"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-646daefd-8d99-4a79-a15c-8f46a605fc90 req-a395bf0e-5080-48e5-a500-e563e5a12786 service nova] Releasing lock "refresh_cache-7f2e574f-a47c-45dc-9261-14de64d5ac7b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'flavor' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cd3176a1-405d-4cd1-84ad-44b41881f465 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.326s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdk (vdc) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:50:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:42 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:50:42 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=6622MB free_disk=25.255233764648438GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance eaf9f058-2194-4e0e-9460-328108758c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ba24bae1-d608-41dd-b928-fad3ba415cc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 25d8bd18-3fc2-4494-aa6a-92e2b31550e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 6de9ed93-5d15-49cc-82fd-f4822fae54af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1dddc689-a053-46d4-a29e-52c8fe78c76d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ed515d2d-7ad6-48bb-b353-abc4e620156c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:50:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:50:43 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Creating image(s)
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Ensure instance console log exists: /opt/stack/data/nova/instances/ba24bae1-d608-41dd-b928-fad3ba415cc1/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Start _get_guest_xml network_info=[{"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '32716474-ddc2-4240-9c9d-4224e1e7ee52', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDqHkzZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba24bae1-d608-41dd-b928-fad3ba415cc1', 'attached_at': '', 'detached_at': '', 'volume_id': '60eef670-6c83-45f8-85af-dc163f4ed233', 'serial': '60eef670-6c83-45f8-85af-dc163f4ed233'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:50:43 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 20:50:43 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba24bae1-d608-41dd-b928-fad3ba415cc1 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDqHkzZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:50:43 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:50:43 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:50:43 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e43074-5110-4687-9f99-3b0a37a73781]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:50:43 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b6053c-8f70-4dd0-92ab-a16548578935]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233] added
Aug 26 20:50:43 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f00dd64-dacc-421c-8562-50fc15f8bd0d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e38493-c268-4ca3-a5f1-53650146d0c0]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDqHkzZf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDqHkzZf" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[001a6e83-ed84-4405-b003-f5d314854427]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WDqHkzZf'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3619bc14-ef8a-43ce-bc0a-e20de3b1b4bf]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ca663f-9024-4dcd-aa5c-7e2e5dc8d213]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:43 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:43 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f1f5f3-c3c7-46a4-98f8-0f00b993389a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260]
Aug 26 20:50:43 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260] successful.
Aug 26 20:50:43 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07ed2a1-6b8e-4c4c-9ced-d7dd7594ff30]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae24445c-4141-474c-8b4e-24b6e63b8aab]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:50:43 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:50:43 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7733dc-9744-4467-9393-9fe5511053b5]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDqHkzZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083028.8250847, ad42cf47-42fb-488f-a44f-cf9824dd4d99 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:43 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] VM Stopped (Lifecycle Event)
Aug 26 20:50:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e33987ca-1df5-461b-a11c-3858cdf0e3c3 None None] [instance: ad42cf47-42fb-488f-a44f-cf9824dd4d99] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26462373935303432', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462373935303432', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1335220622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530961728',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwjoJwGNxGs7G8sGWzXNWPaMUrsR51iAkmlUCNqWZds597i69ly8h77pfkK/8WuXPB5E/6x9PUenKX8xpliIZdz/cCEW9R/w6nPEeKQAuV2ko7KXmy5CGuAoPNDGkI3Tg==',key_name='tempest-keypair-999954189',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:48:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f1adaa2e9f94156a674b7825b4c7b37',ramdisk_id='',reservation_id='r-mlfz9lcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1323308358',owner_user_name='tempest-ServerActionsV293TestJSON-1323308358-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89e2c5481c8d4a5a859f17b8af08626a',uuid=ba24bae1-d608-41dd-b928-fad3ba415cc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converting VIF {"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:50:44 user nova-compute[73476]:   <uuid>ba24bae1-d608-41dd-b928-fad3ba415cc1</uuid>
Aug 26 20:50:44 user nova-compute[73476]:   <name>instance-00000013</name>
Aug 26 20:50:44 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:50:44 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:50:44 user nova-compute[73476]:   <metadata>
Aug 26 20:50:44 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:50:44 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:50:44 user nova-compute[73476]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1335220622</nova:name>
Aug 26 20:50:44 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:50:43</nova:creationTime>
Aug 26 20:50:44 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:50:44 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:50:44 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:50:44 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:50:44 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:50:44 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:50:44 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:50:44 user nova-compute[73476]:       <nova:owner>
Aug 26 20:50:44 user nova-compute[73476]:         <nova:user uuid="89e2c5481c8d4a5a859f17b8af08626a">tempest-ServerActionsV293TestJSON-1323308358-project-member</nova:user>
Aug 26 20:50:44 user nova-compute[73476]:         <nova:project uuid="2f1adaa2e9f94156a674b7825b4c7b37">tempest-ServerActionsV293TestJSON-1323308358</nova:project>
Aug 26 20:50:44 user nova-compute[73476]:       </nova:owner>
Aug 26 20:50:44 user nova-compute[73476]:       <nova:ports>
Aug 26 20:50:44 user nova-compute[73476]:         <nova:port uuid="c9c5fd68-f9ac-4e5b-882d-8dcc870fc942">
Aug 26 20:50:44 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 20:50:44 user nova-compute[73476]:         </nova:port>
Aug 26 20:50:44 user nova-compute[73476]:       </nova:ports>
Aug 26 20:50:44 user nova-compute[73476]:     </nova:instance>
Aug 26 20:50:44 user nova-compute[73476]:   </metadata>
Aug 26 20:50:44 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:50:44 user nova-compute[73476]:     <system>
Aug 26 20:50:44 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:50:44 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:50:44 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:50:44 user nova-compute[73476]:       <entry name="serial">ba24bae1-d608-41dd-b928-fad3ba415cc1</entry>
Aug 26 20:50:44 user nova-compute[73476]:       <entry name="uuid">ba24bae1-d608-41dd-b928-fad3ba415cc1</entry>
Aug 26 20:50:44 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:50:44 user nova-compute[73476]:     </system>
Aug 26 20:50:44 user nova-compute[73476]:   </sysinfo>
Aug 26 20:50:44 user nova-compute[73476]:   <os>
Aug 26 20:50:44 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:50:44 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:50:44 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:50:44 user nova-compute[73476]:   </os>
Aug 26 20:50:44 user nova-compute[73476]:   <features>
Aug 26 20:50:44 user nova-compute[73476]:     <acpi/>
Aug 26 20:50:44 user nova-compute[73476]:     <apic/>
Aug 26 20:50:44 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:50:44 user nova-compute[73476]:   </features>
Aug 26 20:50:44 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:50:44 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:50:44 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:50:44 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:50:44 user nova-compute[73476]:   </clock>
Aug 26 20:50:44 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:50:44 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:50:44 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:50:44 user nova-compute[73476]:   </cpu>
Aug 26 20:50:44 user nova-compute[73476]:   <devices>
Aug 26 20:50:44 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:50:44 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:50:44 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 20:50:44 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:50:44 user nova-compute[73476]:       <serial>60eef670-6c83-45f8-85af-dc163f4ed233</serial>
Aug 26 20:50:44 user nova-compute[73476]:     </disk>
Aug 26 20:50:44 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:50:44 user nova-compute[73476]:       <mac address="fa:16:3e:7f:65:fd"/>
Aug 26 20:50:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:50:44 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:50:44 user nova-compute[73476]:       <target dev="tapc9c5fd68-f9"/>
Aug 26 20:50:44 user nova-compute[73476]:     </interface>
Aug 26 20:50:44 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:50:44 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ba24bae1-d608-41dd-b928-fad3ba415cc1/console.log" append="off"/>
Aug 26 20:50:44 user nova-compute[73476]:     </serial>
Aug 26 20:50:44 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:50:44 user nova-compute[73476]:     <video>
Aug 26 20:50:44 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:50:44 user nova-compute[73476]:     </video>
Aug 26 20:50:44 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:50:44 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:50:44 user nova-compute[73476]:     </rng>
Aug 26 20:50:44 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:50:44 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:50:44 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:50:44 user nova-compute[73476]:     </memballoon>
Aug 26 20:50:44 user nova-compute[73476]:   </devices>
Aug 26 20:50:44 user nova-compute[73476]: </domain>
Aug 26 20:50:44 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1335220622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530961728',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwjoJwGNxGs7G8sGWzXNWPaMUrsR51iAkmlUCNqWZds597i69ly8h77pfkK/8WuXPB5E/6x9PUenKX8xpliIZdz/cCEW9R/w6nPEeKQAuV2ko7KXmy5CGuAoPNDGkI3Tg==',key_name='tempest-keypair-999954189',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:48:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f1adaa2e9f94156a674b7825b4c7b37',ramdisk_id='',reservation_id='r-mlfz9lcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1323308358',owner_user_name='tempest-ServerActionsV293TestJSON-1323308358-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89e2c5481c8d4a5a859f17b8af08626a',uuid=ba24bae1-d608-41dd-b928-fad3ba415cc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converting VIF {"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG os_vif [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9c5fd68-f9, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9c5fd68-f9, col_values=(('external_ids', {'iface-id': 'c9c5fd68-f9ac-4e5b-882d-8dcc870fc942', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:65:fd', 'vm-uuid': 'ba24bae1-d608-41dd-b928-fad3ba415cc1'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:44 user nova-compute[73476]: INFO os_vif [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9')
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] No VIF found with MAC fa:16:3e:7f:65:fd, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:50:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updating instance_info_cache with network_info: [{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:50:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:50:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:50:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-f899af32-864d-4f91-aa06-f390bd5753c5 req-40f42f30-a007-4da4-b94c-37b7feeb08af service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f899af32-864d-4f91-aa06-f390bd5753c5 req-40f42f30-a007-4da4-b94c-37b7feeb08af service nova] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f899af32-864d-4f91-aa06-f390bd5753c5 req-40f42f30-a007-4da4-b94c-37b7feeb08af service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f899af32-864d-4f91-aa06-f390bd5753c5 req-40f42f30-a007-4da4-b94c-37b7feeb08af service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-f899af32-864d-4f91-aa06-f390bd5753c5 req-40f42f30-a007-4da4-b94c-37b7feeb08af service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] No waiting events found dispatching network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:46 user nova-compute[73476]: WARNING nova.compute.manager [req-f899af32-864d-4f91-aa06-f390bd5753c5 req-40f42f30-a007-4da4-b94c-37b7feeb08af service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received unexpected event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 20:50:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083048.1543727, ba24bae1-d608-41dd-b928-fad3ba415cc1 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] VM Resumed (Lifecycle Event)
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:50:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance spawned successfully.
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:50:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083048.1559086, ba24bae1-d608-41dd-b928-fad3ba415cc1 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:50:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] VM Started (Lifecycle Event)
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-c77438f1-e21a-44a6-963b-794b7f5962de req-5dac71b8-9968-4c71-9425-e952115e570f service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c77438f1-e21a-44a6-963b-794b7f5962de req-5dac71b8-9968-4c71-9425-e952115e570f service nova] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c77438f1-e21a-44a6-963b-794b7f5962de req-5dac71b8-9968-4c71-9425-e952115e570f service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c77438f1-e21a-44a6-963b-794b7f5962de req-5dac71b8-9968-4c71-9425-e952115e570f service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-c77438f1-e21a-44a6-963b-794b7f5962de req-5dac71b8-9968-4c71-9425-e952115e570f service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] No waiting events found dispatching network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:50:48 user nova-compute[73476]: WARNING nova.compute.manager [req-c77438f1-e21a-44a6-963b-794b7f5962de req-5dac71b8-9968-4c71-9425-e952115e570f service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received unexpected event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:50:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 20:50:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73476) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 20:50:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6202ef00-1391-4927-90b7-058d1486f6f5 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:50:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:50:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-9f467dbc-e660-40fb-acee-6ed66dd36716 req-9b64b783-69a9-40c7-99ab-f9c48688f375 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received event network-changed-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-9f467dbc-e660-40fb-acee-6ed66dd36716 req-9b64b783-69a9-40c7-99ab-f9c48688f375 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Refreshing instance network info cache due to event network-changed-bac80087-8b43-462b-a88c-f70435e58b2c. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9f467dbc-e660-40fb-acee-6ed66dd36716 req-9b64b783-69a9-40c7-99ab-f9c48688f375 service nova] Acquiring lock "refresh_cache-25d8bd18-3fc2-4494-aa6a-92e2b31550e1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9f467dbc-e660-40fb-acee-6ed66dd36716 req-9b64b783-69a9-40c7-99ab-f9c48688f375 service nova] Acquired lock "refresh_cache-25d8bd18-3fc2-4494-aa6a-92e2b31550e1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-9f467dbc-e660-40fb-acee-6ed66dd36716 req-9b64b783-69a9-40c7-99ab-f9c48688f375 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Refreshing network info cache for port bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:03 user nova-compute[73476]: INFO nova.compute.manager [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Terminating instance
Aug 26 20:51:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:04 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Instance destroyed successfully.
Aug 26 20:51:04 user nova-compute[73476]: DEBUG nova.objects.instance [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'resources' on Instance uuid 25d8bd18-3fc2-4494-aa6a-92e2b31550e1 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-300168865',display_name='tempest-AttachVolumeNegativeTest-server-300168865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-300168865',id=21,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHerluHkJYupt9Z60og6F4quPjSsMeEBJdzkiX/Ss1l39obOZsK+PM3r9scyb5hVI2E3auwCWFSzLp3hpEgEJjU7GBJkltNsajN3QgUxzGFXeDG+1lvi9CHFhrWKsaxucg==',key_name='tempest-keypair-410556146',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-kdbe6ceh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:49:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=25d8bd18-3fc2-4494-aa6a-92e2b31550e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c9:9c,bridge_name='br-int',has_traffic_filtering=True,id=bac80087-8b43-462b-a88c-f70435e58b2c,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac80087-8b') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG os_vif [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c9:9c,bridge_name='br-int',has_traffic_filtering=True,id=bac80087-8b43-462b-a88c-f70435e58b2c,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac80087-8b') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbac80087-8b, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:04 user nova-compute[73476]: INFO os_vif [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c9:9c,bridge_name='br-int',has_traffic_filtering=True,id=bac80087-8b43-462b-a88c-f70435e58b2c,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac80087-8b')
Aug 26 20:51:04 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Deleting instance files /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1_del
Aug 26 20:51:04 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Deletion of /opt/stack/data/nova/instances/25d8bd18-3fc2-4494-aa6a-92e2b31550e1_del complete
Aug 26 20:51:04 user nova-compute[73476]: INFO nova.compute.manager [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Took 0.81 seconds to destroy the instance on the hypervisor.
Aug 26 20:51:04 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:51:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-0c388f9b-4b8c-4601-b3f1-a97a40146e90 req-6ad46a77-41a7-4c86-97f8-15ddfc3995e6 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received event network-vif-unplugged-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0c388f9b-4b8c-4601-b3f1-a97a40146e90 req-6ad46a77-41a7-4c86-97f8-15ddfc3995e6 service nova] Acquiring lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0c388f9b-4b8c-4601-b3f1-a97a40146e90 req-6ad46a77-41a7-4c86-97f8-15ddfc3995e6 service nova] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0c388f9b-4b8c-4601-b3f1-a97a40146e90 req-6ad46a77-41a7-4c86-97f8-15ddfc3995e6 service nova] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-0c388f9b-4b8c-4601-b3f1-a97a40146e90 req-6ad46a77-41a7-4c86-97f8-15ddfc3995e6 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] No waiting events found dispatching network-vif-unplugged-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-0c388f9b-4b8c-4601-b3f1-a97a40146e90 req-6ad46a77-41a7-4c86-97f8-15ddfc3995e6 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received event network-vif-unplugged-bac80087-8b43-462b-a88c-f70435e58b2c for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-3184038f-b825-4b15-8cbd-80acb5541c78 req-535a9267-ce8b-4667-88ba-32274950c4f1 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-changed-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-3184038f-b825-4b15-8cbd-80acb5541c78 req-535a9267-ce8b-4667-88ba-32274950c4f1 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing instance network info cache due to event network-changed-e7a2b1fb-8621-47fb-9630-01a6133a13b3. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3184038f-b825-4b15-8cbd-80acb5541c78 req-535a9267-ce8b-4667-88ba-32274950c4f1 service nova] Acquiring lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3184038f-b825-4b15-8cbd-80acb5541c78 req-535a9267-ce8b-4667-88ba-32274950c4f1 service nova] Acquired lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:51:05 user nova-compute[73476]: DEBUG nova.network.neutron [req-3184038f-b825-4b15-8cbd-80acb5541c78 req-535a9267-ce8b-4667-88ba-32274950c4f1 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Refreshing network info cache for port e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:51:06 user nova-compute[73476]: DEBUG nova.network.neutron [req-9f467dbc-e660-40fb-acee-6ed66dd36716 req-9b64b783-69a9-40c7-99ab-f9c48688f375 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Updated VIF entry in instance network info cache for port bac80087-8b43-462b-a88c-f70435e58b2c. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:51:06 user nova-compute[73476]: DEBUG nova.network.neutron [req-9f467dbc-e660-40fb-acee-6ed66dd36716 req-9b64b783-69a9-40c7-99ab-f9c48688f375 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Updating instance_info_cache with network_info: [{"id": "bac80087-8b43-462b-a88c-f70435e58b2c", "address": "fa:16:3e:76:c9:9c", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac80087-8b", "ovs_interfaceid": "bac80087-8b43-462b-a88c-f70435e58b2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9f467dbc-e660-40fb-acee-6ed66dd36716 req-9b64b783-69a9-40c7-99ab-f9c48688f375 service nova] Releasing lock "refresh_cache-25d8bd18-3fc2-4494-aa6a-92e2b31550e1" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:51:06 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:07 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Took 2.22 seconds to deallocate network for instance.
Aug 26 20:51:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ffc002f-541b-4a07-8949-afdeee83f967 req-10ecdaf0-cba9-4f82-b8bc-cb9de3cfe776 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received event network-vif-plugged-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ffc002f-541b-4a07-8949-afdeee83f967 req-10ecdaf0-cba9-4f82-b8bc-cb9de3cfe776 service nova] Acquiring lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ffc002f-541b-4a07-8949-afdeee83f967 req-10ecdaf0-cba9-4f82-b8bc-cb9de3cfe776 service nova] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ffc002f-541b-4a07-8949-afdeee83f967 req-10ecdaf0-cba9-4f82-b8bc-cb9de3cfe776 service nova] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ffc002f-541b-4a07-8949-afdeee83f967 req-10ecdaf0-cba9-4f82-b8bc-cb9de3cfe776 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] No waiting events found dispatching network-vif-plugged-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:07 user nova-compute[73476]: WARNING nova.compute.manager [req-9ffc002f-541b-4a07-8949-afdeee83f967 req-10ecdaf0-cba9-4f82-b8bc-cb9de3cfe776 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received unexpected event network-vif-plugged-bac80087-8b43-462b-a88c-f70435e58b2c for instance with vm_state active and task_state deleting.
Aug 26 20:51:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ffc002f-541b-4a07-8949-afdeee83f967 req-10ecdaf0-cba9-4f82-b8bc-cb9de3cfe776 service nova] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Received event network-vif-deleted-bac80087-8b43-462b-a88c-f70435e58b2c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-3184038f-b825-4b15-8cbd-80acb5541c78 req-535a9267-ce8b-4667-88ba-32274950c4f1 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updated VIF entry in instance network info cache for port e7a2b1fb-8621-47fb-9630-01a6133a13b3. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-3184038f-b825-4b15-8cbd-80acb5541c78 req-535a9267-ce8b-4667-88ba-32274950c4f1 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [{"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3184038f-b825-4b15-8cbd-80acb5541c78 req-535a9267-ce8b-4667-88ba-32274950c4f1 service nova] Releasing lock "refresh_cache-5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:51:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:07 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Deleted allocations for instance 25d8bd18-3fc2-4494-aa6a-92e2b31550e1
Aug 26 20:51:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8085b6f5-b5e5-4020-87c3-a687d00da19b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "25d8bd18-3fc2-4494-aa6a-92e2b31550e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.825s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:09 user nova-compute[73476]: INFO nova.compute.manager [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Terminating instance
Aug 26 20:51:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-e75fb1c4-e67c-4f99-b4e4-e5a0ef5ef54d req-85f81405-a5c2-48a2-81de-3420dfd4696a service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e75fb1c4-e67c-4f99-b4e4-e5a0ef5ef54d req-85f81405-a5c2-48a2-81de-3420dfd4696a service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e75fb1c4-e67c-4f99-b4e4-e5a0ef5ef54d req-85f81405-a5c2-48a2-81de-3420dfd4696a service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e75fb1c4-e67c-4f99-b4e4-e5a0ef5ef54d req-85f81405-a5c2-48a2-81de-3420dfd4696a service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-e75fb1c4-e67c-4f99-b4e4-e5a0ef5ef54d req-85f81405-a5c2-48a2-81de-3420dfd4696a service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-unplugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG nova.compute.manager [req-e75fb1c4-e67c-4f99-b4e4-e5a0ef5ef54d req-85f81405-a5c2-48a2-81de-3420dfd4696a service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-bc6e2ad9-7128-4b63-a8cd-52427361bf07 req-e37f39df-1ba1-4b71-bc36-7e239844d0b3 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bc6e2ad9-7128-4b63-a8cd-52427361bf07 req-e37f39df-1ba1-4b71-bc36-7e239844d0b3 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bc6e2ad9-7128-4b63-a8cd-52427361bf07 req-e37f39df-1ba1-4b71-bc36-7e239844d0b3 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bc6e2ad9-7128-4b63-a8cd-52427361bf07 req-e37f39df-1ba1-4b71-bc36-7e239844d0b3 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-bc6e2ad9-7128-4b63-a8cd-52427361bf07 req-e37f39df-1ba1-4b71-bc36-7e239844d0b3 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-unplugged-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-bc6e2ad9-7128-4b63-a8cd-52427361bf07 req-e37f39df-1ba1-4b71-bc36-7e239844d0b3 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-93c27189-8f35-4144-a932-fb997648e90e for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-c2119d13-2750-4dde-8a07-7ec28c878d32 req-bcea699b-f8f3-4ab2-a54a-863d3dc5dc3f service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c2119d13-2750-4dde-8a07-7ec28c878d32 req-bcea699b-f8f3-4ab2-a54a-863d3dc5dc3f service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c2119d13-2750-4dde-8a07-7ec28c878d32 req-bcea699b-f8f3-4ab2-a54a-863d3dc5dc3f service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c2119d13-2750-4dde-8a07-7ec28c878d32 req-bcea699b-f8f3-4ab2-a54a-863d3dc5dc3f service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-c2119d13-2750-4dde-8a07-7ec28c878d32 req-bcea699b-f8f3-4ab2-a54a-863d3dc5dc3f service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-unplugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-c2119d13-2750-4dde-8a07-7ec28c878d32 req-bcea699b-f8f3-4ab2-a54a-863d3dc5dc3f service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Instance destroyed successfully.
Aug 26 20:51:10 user nova-compute[73476]: DEBUG nova.objects.instance [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lazy-loading 'resources' on Instance uuid 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "address": "fa:16:3e:7e:a6:a1", "network": {"id": "e03a08da-e8ea-4325-ad8e-fb88bccc6b74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-618316103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a2b1fb-86", "ovs_interfaceid": "e7a2b1fb-8621-47fb-9630-01a6133a13b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7a2b1fb-8621-47fb-9630-01a6133a13b3,network=Network(e03a08da-e8ea-4325-ad8e-fb88bccc6b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a2b1fb-86') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7a2b1fb-8621-47fb-9630-01a6133a13b3,network=Network(e03a08da-e8ea-4325-ad8e-fb88bccc6b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a2b1fb-86') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7a2b1fb-86, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: INFO os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a6:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7a2b1fb-8621-47fb-9630-01a6133a13b3,network=Network(e03a08da-e8ea-4325-ad8e-fb88bccc6b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a2b1fb-86')
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc067c603-a4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc067c603-a4') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc067c603-a4, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: INFO os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:d2,bridge_name='br-int',has_traffic_filtering=True,id=c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc067c603-a4')
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:91:8a,bridge_name='br-int',has_traffic_filtering=True,id=420a36c6-a0de-4cad-af7d-19aae1ea7571,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap420a36c6-a0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:91:8a,bridge_name='br-int',has_traffic_filtering=True,id=420a36c6-a0de-4cad-af7d-19aae1ea7571,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap420a36c6-a0') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap420a36c6-a0, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: INFO os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:91:8a,bridge_name='br-int',has_traffic_filtering=True,id=420a36c6-a0de-4cad-af7d-19aae1ea7571,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap420a36c6-a0')
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:06:c4,bridge_name='br-int',has_traffic_filtering=True,id=cab225e4-c201-4e24-878b-34d0aedaa365,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab225e4-c2') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:06:c4,bridge_name='br-int',has_traffic_filtering=True,id=cab225e4-c201-4e24-878b-34d0aedaa365,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab225e4-c2') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcab225e4-c2, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: INFO os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:06:c4,bridge_name='br-int',has_traffic_filtering=True,id=cab225e4-c201-4e24-878b-34d0aedaa365,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab225e4-c2')
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:e7,bridge_name='br-int',has_traffic_filtering=True,id=93c27189-8f35-4144-a932-fb997648e90e,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c27189-8f') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:e7,bridge_name='br-int',has_traffic_filtering=True,id=93c27189-8f35-4144-a932-fb997648e90e,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c27189-8f') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93c27189-8f, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: INFO os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:e7,bridge_name='br-int',has_traffic_filtering=True,id=93c27189-8f35-4144-a932-fb997648e90e,network=Network(666a2337-a6e5-4f8c-89e1-362a75dbbd8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c27189-8f')
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:4d,bridge_name='br-int',has_traffic_filtering=True,id=baeeff04-50ca-4ee8-b2f3-2437a3225a5a,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeeff04-50') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:4d,bridge_name='br-int',has_traffic_filtering=True,id=baeeff04-50ca-4ee8-b2f3-2437a3225a5a,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeeff04-50') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaeeff04-50, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: INFO os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:4d,bridge_name='br-int',has_traffic_filtering=True,id=baeeff04-50ca-4ee8-b2f3-2437a3225a5a,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeeff04-50')
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T20:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1674380226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1674380226',id=20,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDJ59RqWoEFxT54Z8fj2phywrj5sUBNbbjpIR4Hb49s7tGOPsHkewCOAMc3mF6fcSdiBFi+8ND/mDC9gBa6Zc9IIuXKEVsGnSAYeRIN2fcFuJQP9Rq+ntd9OMBcN+0mlA==',key_name='tempest-keypair-2049480948',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1411d212654847d688386973f7b6de8a',ramdisk_id='',reservation_id='r-vnejaknh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-454866110',owner_user_name='tempest-TaggedBootDevicesTest-454866110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4af3744acebb45cc912456b064371c64',uuid=5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converting VIF {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e9:ac,bridge_name='br-int',has_traffic_filtering=True,id=4384aff6-53bf-419c-b73d-50ae3c9fa1b7,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4384aff6-53') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e9:ac,bridge_name='br-int',has_traffic_filtering=True,id=4384aff6-53bf-419c-b73d-50ae3c9fa1b7,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4384aff6-53') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4384aff6-53, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:11 user nova-compute[73476]: INFO os_vif [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e9:ac,bridge_name='br-int',has_traffic_filtering=True,id=4384aff6-53bf-419c-b73d-50ae3c9fa1b7,network=Network(721dd160-d072-492c-b4dd-deb2099f3b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4384aff6-53')
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfqRsvdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:51:11 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bd89ac-929f-4aed-9b02-04df70289374]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29c4bc6-eae0-40f7-b79f-3833b3cbd46f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02b53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0'): ({'sdi'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Removing single pathed devices sdi {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5d8340-3105-4bd3-b80a-ccdb8e2ffb03]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b0beb4-bc30-4fa7-bffb-443edd69d9ec]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Flushing IO for device /dev/sdi {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4fa1fd-430e-4e4f-9939-a2f82892017f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[032b20cb-80ab-45c5-9d5d-45f14bb61105]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] SCSI volumes sdi have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.059s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51ccd3c-fdb1-4ea6-be79-0c0f6388d40b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:11 user nova-compute[73476]: WARNING nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-e7a2b1fb-8621-47fb-9630-01a6133a13b3 for instance with vm_state active and task_state deleting.
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-unplugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:11 user nova-compute[73476]: WARNING nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39 for instance with vm_state active and task_state deleting.
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-unplugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c6ea7e6-a036-48f1-bd79-2c3fc391bf5b req-10954c4f-bcf1-40aa-9a63-27c49193b022 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9584ed-42f3-4cac-93f9-aec293a60e5c]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0, portal: 172.16.0.220,3260]
Aug 26 20:51:11 user nova-compute[73476]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0, portal: 172.16.0.220,3260] successful.
Aug 26 20:51:11 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c1d1b3-ffad-4325-aaef-fe223054c8f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d306b8-18da-4c7f-b316-3574e660c443]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] <== disconnect_volume: return (386ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwpnKXvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:51:11 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7907de65-87d4-4b3e-9c64-ca3713933dc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f08b1ad-0f7e-4a78-a101-8ddc83ee4954]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:51:11 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:11 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02b53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa'): ({'sdj'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Removing single pathed devices sdj {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb7b608-ec85-4a2a-9229-3f200eaf2e9d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccda35dc-82b5-496a-a256-93564606b7f5]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Flushing IO for device /dev/sdj {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1ad73e-641b-43f9-a336-24e5967b6233]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.039s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3c9af9-24c5-4bdd-8c01-f96cdbbbc604]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] SCSI volumes sdj have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7083c9a0-fa3f-41aa-bcdf-2878fbc0a6f3]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:11 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f38f5-dd71-4607-b79b-4615039e256c]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa, portal: 172.16.0.220,3260]
Aug 26 20:51:12 user nova-compute[73476]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa, portal: 172.16.0.220,3260] successful.
Aug 26 20:51:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9febb691-5958-42d0-92ac-3cc5ad5ecdfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c489a0b-617b-450f-aab9-ae032b04fe0c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] <== disconnect_volume: return (365ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfBDRMSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:51:12 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-df3e6a9e-fd11-4887-97a8-74aac81de955 req-1c79f3fa-a6b7-4b6d-912b-3572fb3ffd2a service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df3e6a9e-fd11-4887-97a8-74aac81de955 req-1c79f3fa-a6b7-4b6d-912b-3572fb3ffd2a service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df3e6a9e-fd11-4887-97a8-74aac81de955 req-1c79f3fa-a6b7-4b6d-912b-3572fb3ffd2a service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df3e6a9e-fd11-4887-97a8-74aac81de955 req-1c79f3fa-a6b7-4b6d-912b-3572fb3ffd2a service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-df3e6a9e-fd11-4887-97a8-74aac81de955 req-1c79f3fa-a6b7-4b6d-912b-3572fb3ffd2a service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:12 user nova-compute[73476]: WARNING nova.compute.manager [req-df3e6a9e-fd11-4887-97a8-74aac81de955 req-1c79f3fa-a6b7-4b6d-912b-3572fb3ffd2a service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-93c27189-8f35-4144-a932-fb997648e90e for instance with vm_state active and task_state deleting.
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc90d82c-a53a-48e7-991c-0f16acf1cc9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64e0740-1436-483a-a5de-21d3cac93635]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:12 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:12 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:51:12 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:51:12 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:12 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:12 user nova-compute[73476]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 (non-flash)
Aug 26 20:51:12 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:51:12 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258cf80a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34'): ({'sdk'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Removing single pathed devices sdk {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e08c8d-1efa-4608-9ad2-ed0eac21307f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[56230df8-f008-419d-8494-c6ed4803519e]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Flushing IO for device /dev/sdk {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[34987825-2f42-4523-b3e7-edc896173853]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.050s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5126dd-1ae1-4882-b354-aeff07c8707f]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] SCSI volumes sdk have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e0de3-9248-4c56-b952-eda02582e47f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-6df776d1-774e-49f9-a5ee-b24d4eb06ec0 req-000fa48b-03d7-46d3-8fde-4b51ffc7146c service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6df776d1-774e-49f9-a5ee-b24d4eb06ec0 req-000fa48b-03d7-46d3-8fde-4b51ffc7146c service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6df776d1-774e-49f9-a5ee-b24d4eb06ec0 req-000fa48b-03d7-46d3-8fde-4b51ffc7146c service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6df776d1-774e-49f9-a5ee-b24d4eb06ec0 req-000fa48b-03d7-46d3-8fde-4b51ffc7146c service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-6df776d1-774e-49f9-a5ee-b24d4eb06ec0 req-000fa48b-03d7-46d3-8fde-4b51ffc7146c service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:12 user nova-compute[73476]: WARNING nova.compute.manager [req-6df776d1-774e-49f9-a5ee-b24d4eb06ec0 req-000fa48b-03d7-46d3-8fde-4b51ffc7146c service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 for instance with vm_state active and task_state deleting.
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9347deec-22d9-4449-8bb6-7be055927c4a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34, portal: 172.16.0.220,3260]
Aug 26 20:51:12 user nova-compute[73476]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34, portal: 172.16.0.220,3260] successful.
Aug 26 20:51:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e37471-fa92-49b6-889f-f3579b631e34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef761168-c09a-4dd1-9998-951eb3b930a3]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] <== disconnect_volume: return (334ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:51:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Deleting instance files /opt/stack/data/nova/instances/5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb_del
Aug 26 20:51:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Deletion of /opt/stack/data/nova/instances/5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb_del complete
Aug 26 20:51:12 user nova-compute[73476]: INFO nova.compute.manager [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Took 3.41 seconds to destroy the instance on the hypervisor.
Aug 26 20:51:12 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:51:12 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:13 user nova-compute[73476]: WARNING nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-420a36c6-a0de-4cad-af7d-19aae1ea7571 for instance with vm_state active and task_state deleting.
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-unplugged-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-cab225e4-c201-4e24-878b-34d0aedaa365 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:13 user nova-compute[73476]: WARNING nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-cab225e4-c201-4e24-878b-34d0aedaa365 for instance with vm_state active and task_state deleting.
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-unplugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-unplugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-plugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Acquiring lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] No waiting events found dispatching network-vif-plugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:13 user nova-compute[73476]: WARNING nova.compute.manager [req-9583bcb2-fc09-4afe-bbb1-6382e89e83a3 req-2208ac22-ced8-4b43-bae9-396807e18bdf service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received unexpected event network-vif-plugged-baeeff04-50ca-4ee8-b2f3-2437a3225a5a for instance with vm_state active and task_state deleting.
Aug 26 20:51:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:14 user nova-compute[73476]: INFO nova.compute.manager [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Terminating instance
Aug 26 20:51:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:51:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Instance destroyed successfully.
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'resources' on Instance uuid eaf9f058-2194-4e0e-9460-328108758c42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-924396',display_name='tempest-ServerActionsTestOtherA-server-1638955500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-924396',id=14,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV/yd8kfxlaTWXrDZ3wbLsadxJe1f2WQOA3s+97nsG/XDorWSKUuwbAAV+UBcfNkZOqvbKg3jvF1sQHB2BfsglNHCVhOpK2aXH6Iq8Qok+VhT6HbE2h3S1fpQjHJ8cjDw==',key_name='tempest-keypair-710174093',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:48:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-qgortcq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=eaf9f058-2194-4e0e-9460-328108758c42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "920e6ff4-145c-41b3-b513-49437e60144b", "address": "fa:16:3e:1c:de:05", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap920e6ff4-14", "ovs_interfaceid": "920e6ff4-145c-41b3-b513-49437e60144b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG os_vif [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap920e6ff4-14, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:15 user nova-compute[73476]: INFO os_vif [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:de:05,bridge_name='br-int',has_traffic_filtering=True,id=920e6ff4-145c-41b3-b513-49437e60144b,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920e6ff4-14')
Aug 26 20:51:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Deleting instance files /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42_del
Aug 26 20:51:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Deletion of /opt/stack/data/nova/instances/eaf9f058-2194-4e0e-9460-328108758c42_del complete
Aug 26 20:51:15 user nova-compute[73476]: INFO nova.compute.manager [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 20:51:15 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-deleted-e7a2b1fb-8621-47fb-9630-01a6133a13b3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:15 user nova-compute[73476]: INFO nova.compute.manager [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Neutron deleted interface e7a2b1fb-8621-47fb-9630-01a6133a13b3; detaching it from the instance and deleting it from the info cache
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.network.neutron [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [{"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93c27189-8f35-4144-a932-fb997648e90e", "address": "fa:16:3e:74:dd:e7", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c27189-8f", "ovs_interfaceid": "93c27189-8f35-4144-a932-fb997648e90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Detach interface failed, port_id=e7a2b1fb-8621-47fb-9630-01a6133a13b3, reason: Instance 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-unplugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] No waiting events found dispatching network-vif-unplugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-unplugged-920e6ff4-145c-41b3-b513-49437e60144b for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] Acquiring lock "eaf9f058-2194-4e0e-9460-328108758c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] Lock "eaf9f058-2194-4e0e-9460-328108758c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] No waiting events found dispatching network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:15 user nova-compute[73476]: WARNING nova.compute.manager [req-4befd9eb-7857-4d76-80a7-51b5f306d7a7 req-593d14ba-408e-41eb-b759-810753cf75ba service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received unexpected event network-vif-plugged-920e6ff4-145c-41b3-b513-49437e60144b for instance with vm_state active and task_state deleting.
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:17 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Took 2.02 seconds to deallocate network for instance.
Aug 26 20:51:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-deleted-93c27189-8f35-4144-a932-fb997648e90e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:17 user nova-compute[73476]: INFO nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Neutron deleted interface 93c27189-8f35-4144-a932-fb997648e90e; detaching it from the instance and deleting it from the info cache
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.network.neutron [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [{"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "address": "fa:16:3e:16:90:4d", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeeff04-50", "ovs_interfaceid": "baeeff04-50ca-4ee8-b2f3-2437a3225a5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Detach interface failed, port_id=93c27189-8f35-4144-a932-fb997648e90e, reason: Instance 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-deleted-baeeff04-50ca-4ee8-b2f3-2437a3225a5a {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:17 user nova-compute[73476]: INFO nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Neutron deleted interface baeeff04-50ca-4ee8-b2f3-2437a3225a5a; detaching it from the instance and deleting it from the info cache
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.network.neutron [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [{"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "address": "fa:16:3e:65:e9:ac", "network": {"id": "721dd160-d072-492c-b4dd-deb2099f3b49", "bridge": "br-int", "label": "tempest-device-tagging-net2-1564293309", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4384aff6-53", "ovs_interfaceid": "4384aff6-53bf-419c-b73d-50ae3c9fa1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Detach interface failed, port_id=baeeff04-50ca-4ee8-b2f3-2437a3225a5a, reason: Instance 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Received event network-vif-deleted-920e6ff4-145c-41b3-b513-49437e60144b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-deleted-4384aff6-53bf-419c-b73d-50ae3c9fa1b7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:17 user nova-compute[73476]: INFO nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Neutron deleted interface 4384aff6-53bf-419c-b73d-50ae3c9fa1b7; detaching it from the instance and deleting it from the info cache
Aug 26 20:51:17 user nova-compute[73476]: DEBUG nova.network.neutron [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [{"id": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "address": "fa:16:3e:7e:b0:d2", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc067c603-a4", "ovs_interfaceid": "c067c603-a4e0-4fcc-8dfa-abb3dc4c6b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "address": "fa:16:3e:8f:91:8a", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420a36c6-a0", "ovs_interfaceid": "420a36c6-a0de-4cad-af7d-19aae1ea7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cab225e4-c201-4e24-878b-34d0aedaa365", "address": "fa:16:3e:19:06:c4", "network": {"id": "666a2337-a6e5-4f8c-89e1-362a75dbbd8c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1890995920", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1411d212654847d688386973f7b6de8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab225e4-c2", "ovs_interfaceid": "cab225e4-c201-4e24-878b-34d0aedaa365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:18 user nova-compute[73476]: DEBUG nova.compute.manager [req-1329766e-196f-4fc4-b0dc-aeeaa50a5db5 req-15b663cd-db9a-44af-98df-a45139ebb8d9 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Detach interface failed, port_id=4384aff6-53bf-419c-b73d-50ae3c9fa1b7, reason: Instance 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:51:18 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:51:18 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:51:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:18 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:18 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Took 5.79 seconds to deallocate network for instance.
Aug 26 20:51:18 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Deleted allocations for instance eaf9f058-2194-4e0e-9460-328108758c42
Aug 26 20:51:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d9fb56c7-1860-44ee-83f9-cc8fca6c4805 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "eaf9f058-2194-4e0e-9460-328108758c42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.619s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:19 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083064.6280975, 25d8bd18-3fc2-4494-aa6a-92e2b31550e1 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:51:19 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] VM Stopped (Lifecycle Event)
Aug 26 20:51:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4891e57d-7cfd-4f57-a4b8-3b9cd43ca882 None None] [instance: 25d8bd18-3fc2-4494-aa6a-92e2b31550e1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:51:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-800d2982-7916-404f-8c68-3afc18615a20 req-0687854b-edf9-430e-a287-1119c8914648 service nova] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Received event network-vif-deleted-cab225e4-c201-4e24-878b-34d0aedaa365 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:21 user nova-compute[73476]: INFO nova.compute.manager [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Took 2.88 seconds to detach 3 volumes for instance.
Aug 26 20:51:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:21 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:51:21 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:51:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:21 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Deleted allocations for instance 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb
Aug 26 20:51:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-52477777-5452-4279-8e6f-79c7185d4369 tempest-TaggedBootDevicesTest-454866110 tempest-TaggedBootDevicesTest-454866110-project-member] Lock "5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.915s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:25 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083070.985434, 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:51:25 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] VM Stopped (Lifecycle Event)
Aug 26 20:51:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-123da4cb-6c2c-41b5-ad93-15c720154316 None None] [instance: 5a5aaf7b-1694-4bf0-b88c-884d69d9cbdb] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:51:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:27 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:51:28 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:30 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083075.6320992, eaf9f058-2194-4e0e-9460-328108758c42 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:51:30 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: eaf9f058-2194-4e0e-9460-328108758c42] VM Stopped (Lifecycle Event)
Aug 26 20:51:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7a2cb866-4fb6-458e-b861-d8e430bf1931 None None] [instance: eaf9f058-2194-4e0e-9460-328108758c42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:51:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:31 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:51:32 user nova-compute[73476]: INFO nova.compute.claims [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Claim successful on node user
Aug 26 20:51:32 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:32 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:51:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:51:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG nova.policy [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e52fb5b6f63484e9774df9788000210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c34d572b644f28af2154f4a90b292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:51:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Creating image(s)
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "/opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "/opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.169s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk 1073741824" returned: 0 in 0.054s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:51:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:34 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Cannot resize image /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:51:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:51:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Ensure instance console log exists: /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:51:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:34 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Successfully created port: e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:51:34 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Successfully updated port: e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "refresh_cache-ef7f0adb-9324-43ac-b3b7-593900b1576f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquired lock "refresh_cache-ef7f0adb-9324-43ac-b3b7-593900b1576f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-aef76c25-beaf-48a9-af35-42c190ad31b3 req-49b72b61-31e8-4b20-8954-503a78eb4743 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received event network-changed-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-aef76c25-beaf-48a9-af35-42c190ad31b3 req-49b72b61-31e8-4b20-8954-503a78eb4743 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Refreshing instance network info cache due to event network-changed-e016713d-e390-4c42-b097-4907edc7ba6e. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-aef76c25-beaf-48a9-af35-42c190ad31b3 req-49b72b61-31e8-4b20-8954-503a78eb4743 service nova] Acquiring lock "refresh_cache-ef7f0adb-9324-43ac-b3b7-593900b1576f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Updating instance_info_cache with network_info: [{"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Releasing lock "refresh_cache-ef7f0adb-9324-43ac-b3b7-593900b1576f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Instance network_info: |[{"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-aef76c25-beaf-48a9-af35-42c190ad31b3 req-49b72b61-31e8-4b20-8954-503a78eb4743 service nova] Acquired lock "refresh_cache-ef7f0adb-9324-43ac-b3b7-593900b1576f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.network.neutron [req-aef76c25-beaf-48a9-af35-42c190ad31b3 req-49b72b61-31e8-4b20-8954-503a78eb4743 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Refreshing network info cache for port e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Start _get_guest_xml network_info=[{"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:51:35 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:51:35 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:51:35 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1984423643',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1984423643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1984423',id=25,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9HMVD9jJy2zn+zWRa4Kr1qjaVcsd1nqX44msMW1sKlO4fHuF4Pg1cNJrtaAHxaZyif5l2WJ++i7I0L3rv+MknmwIgUcy+DTexJxIJsOM4FSGKsJXnitIp2TH3wJ8lYMA==',key_name='tempest-keypair-1698214889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09c34d572b644f28af2154f4a90b292f',ramdisk_id='',reservation_id='r-wl07ltd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-219026822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e52fb5b6f63484e9774df9788000210',uuid=ef7f0adb-9324-43ac-b3b7-593900b1576f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Converting VIF {"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:f3:2f,bridge_name='br-int',has_traffic_filtering=True,id=e016713d-e390-4c42-b097-4907edc7ba6e,network=Network(52a0d985-b54c-47d2-8403-0284c7d75462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape016713d-e3') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lazy-loading 'pci_devices' on Instance uuid ef7f0adb-9324-43ac-b3b7-593900b1576f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:51:36 user nova-compute[73476]:   <uuid>ef7f0adb-9324-43ac-b3b7-593900b1576f</uuid>
Aug 26 20:51:36 user nova-compute[73476]:   <name>instance-00000019</name>
Aug 26 20:51:36 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:51:36 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:51:36 user nova-compute[73476]:   <metadata>
Aug 26 20:51:36 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:51:36 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:51:36 user nova-compute[73476]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1984423643</nova:name>
Aug 26 20:51:36 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:51:35</nova:creationTime>
Aug 26 20:51:36 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:51:36 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:51:36 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:51:36 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:51:36 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:51:36 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:51:36 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:51:36 user nova-compute[73476]:       <nova:owner>
Aug 26 20:51:36 user nova-compute[73476]:         <nova:user uuid="9e52fb5b6f63484e9774df9788000210">tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member</nova:user>
Aug 26 20:51:36 user nova-compute[73476]:         <nova:project uuid="09c34d572b644f28af2154f4a90b292f">tempest-TestServerVolumeAttachScenarioOldVersion-219026822</nova:project>
Aug 26 20:51:36 user nova-compute[73476]:       </nova:owner>
Aug 26 20:51:36 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:51:36 user nova-compute[73476]:       <nova:ports>
Aug 26 20:51:36 user nova-compute[73476]:         <nova:port uuid="e016713d-e390-4c42-b097-4907edc7ba6e">
Aug 26 20:51:36 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 20:51:36 user nova-compute[73476]:         </nova:port>
Aug 26 20:51:36 user nova-compute[73476]:       </nova:ports>
Aug 26 20:51:36 user nova-compute[73476]:     </nova:instance>
Aug 26 20:51:36 user nova-compute[73476]:   </metadata>
Aug 26 20:51:36 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:51:36 user nova-compute[73476]:     <system>
Aug 26 20:51:36 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:51:36 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:51:36 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:51:36 user nova-compute[73476]:       <entry name="serial">ef7f0adb-9324-43ac-b3b7-593900b1576f</entry>
Aug 26 20:51:36 user nova-compute[73476]:       <entry name="uuid">ef7f0adb-9324-43ac-b3b7-593900b1576f</entry>
Aug 26 20:51:36 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:51:36 user nova-compute[73476]:     </system>
Aug 26 20:51:36 user nova-compute[73476]:   </sysinfo>
Aug 26 20:51:36 user nova-compute[73476]:   <os>
Aug 26 20:51:36 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:51:36 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:51:36 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:51:36 user nova-compute[73476]:   </os>
Aug 26 20:51:36 user nova-compute[73476]:   <features>
Aug 26 20:51:36 user nova-compute[73476]:     <acpi/>
Aug 26 20:51:36 user nova-compute[73476]:     <apic/>
Aug 26 20:51:36 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:51:36 user nova-compute[73476]:   </features>
Aug 26 20:51:36 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:51:36 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:51:36 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:51:36 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:51:36 user nova-compute[73476]:   </clock>
Aug 26 20:51:36 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:51:36 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:51:36 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:51:36 user nova-compute[73476]:   </cpu>
Aug 26 20:51:36 user nova-compute[73476]:   <devices>
Aug 26 20:51:36 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:51:36 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:51:36 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk"/>
Aug 26 20:51:36 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:51:36 user nova-compute[73476]:     </disk>
Aug 26 20:51:36 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:51:36 user nova-compute[73476]:       <mac address="fa:16:3e:7a:f3:2f"/>
Aug 26 20:51:36 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:51:36 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:51:36 user nova-compute[73476]:       <target dev="tape016713d-e3"/>
Aug 26 20:51:36 user nova-compute[73476]:     </interface>
Aug 26 20:51:36 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:51:36 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/console.log" append="off"/>
Aug 26 20:51:36 user nova-compute[73476]:     </serial>
Aug 26 20:51:36 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:51:36 user nova-compute[73476]:     <video>
Aug 26 20:51:36 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:51:36 user nova-compute[73476]:     </video>
Aug 26 20:51:36 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:51:36 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:51:36 user nova-compute[73476]:     </rng>
Aug 26 20:51:36 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:51:36 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:51:36 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:51:36 user nova-compute[73476]:     </memballoon>
Aug 26 20:51:36 user nova-compute[73476]:   </devices>
Aug 26 20:51:36 user nova-compute[73476]: </domain>
Aug 26 20:51:36 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1984423643',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1984423643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1984423',id=25,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9HMVD9jJy2zn+zWRa4Kr1qjaVcsd1nqX44msMW1sKlO4fHuF4Pg1cNJrtaAHxaZyif5l2WJ++i7I0L3rv+MknmwIgUcy+DTexJxIJsOM4FSGKsJXnitIp2TH3wJ8lYMA==',key_name='tempest-keypair-1698214889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09c34d572b644f28af2154f4a90b292f',ramdisk_id='',reservation_id='r-wl07ltd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-219026822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e52fb5b6f63484e9774df9788000210',uuid=ef7f0adb-9324-43ac-b3b7-593900b1576f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Converting VIF {"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:f3:2f,bridge_name='br-int',has_traffic_filtering=True,id=e016713d-e390-4c42-b097-4907edc7ba6e,network=Network(52a0d985-b54c-47d2-8403-0284c7d75462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape016713d-e3') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG os_vif [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:f3:2f,bridge_name='br-int',has_traffic_filtering=True,id=e016713d-e390-4c42-b097-4907edc7ba6e,network=Network(52a0d985-b54c-47d2-8403-0284c7d75462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape016713d-e3') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape016713d-e3, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape016713d-e3, col_values=(('external_ids', {'iface-id': 'e016713d-e390-4c42-b097-4907edc7ba6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:f3:2f', 'vm-uuid': 'ef7f0adb-9324-43ac-b3b7-593900b1576f'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:36 user nova-compute[73476]: INFO os_vif [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:f3:2f,bridge_name='br-int',has_traffic_filtering=True,id=e016713d-e390-4c42-b097-4907edc7ba6e,network=Network(52a0d985-b54c-47d2-8403-0284c7d75462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape016713d-e3')
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] No VIF found with MAC fa:16:3e:7a:f3:2f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:36 user nova-compute[73476]: INFO nova.compute.manager [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Terminating instance
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.network.neutron [req-aef76c25-beaf-48a9-af35-42c190ad31b3 req-49b72b61-31e8-4b20-8954-503a78eb4743 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Updated VIF entry in instance network info cache for port e016713d-e390-4c42-b097-4907edc7ba6e. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.network.neutron [req-aef76c25-beaf-48a9-af35-42c190ad31b3 req-49b72b61-31e8-4b20-8954-503a78eb4743 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Updating instance_info_cache with network_info: [{"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-aef76c25-beaf-48a9-af35-42c190ad31b3 req-49b72b61-31e8-4b20-8954-503a78eb4743 service nova] Releasing lock "refresh_cache-ef7f0adb-9324-43ac-b3b7-593900b1576f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:36 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:51:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Instance destroyed successfully.
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.objects.instance [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'resources' on Instance uuid 7f2e574f-a47c-45dc-9261-14de64d5ac7b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-156038062',display_name='tempest-TestMinimumBasicScenario-server-156038062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-156038062',id=15,image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkJCbzXhqk2qkP5QbVoSQJsfJpi0quIEXOrN1Y/M8/7w5E0N6PnAbbhRBVuWJG+5R2Z7GtWVh0b63siP4vpOV4BZpC3h7aMxmwFg7L7UHYfBWP0Fi7o7fm8PbJV8DrNFw==',key_name='tempest-TestMinimumBasicScenario-802005258',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c0bf9d46b5447a495d0cf45071e0c27',ramdisk_id='',reservation_id='r-nljd6hy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90f6bd11-46de-438c-b4ec-77bdac4447f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1097465264',owner_user_name='tempest-TestMinimumBasicScenario-1097465264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:48:52Z,user_data=None,user_id='818cdd5f2ecf42739eb1d1d44c2d78e5',uuid=7f2e574f-a47c-45dc-9261-14de64d5ac7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converting VIF {"id": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "address": "fa:16:3e:1b:25:fc", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31732c2a-94", "ovs_interfaceid": "31732c2a-94a0-4be3-b5f5-fbb1488b7161", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG os_vif [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31732c2a-94, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:37 user nova-compute[73476]: INFO os_vif [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:25:fc,bridge_name='br-int',has_traffic_filtering=True,id=31732c2a-94a0-4be3-b5f5-fbb1488b7161,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31732c2a-94')
Aug 26 20:51:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Deleting instance files /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b_del
Aug 26 20:51:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Deletion of /opt/stack/data/nova/instances/7f2e574f-a47c-45dc-9261-14de64d5ac7b_del complete
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-unplugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] No waiting events found dispatching network-vif-unplugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-unplugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] Acquiring lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] No waiting events found dispatching network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:37 user nova-compute[73476]: WARNING nova.compute.manager [req-80ae9a12-2f2a-436f-aac6-0c9e7982aac8 req-150ef929-6088-48e0-875c-83b87dcd43e7 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received unexpected event network-vif-plugged-31732c2a-94a0-4be3-b5f5-fbb1488b7161 for instance with vm_state active and task_state deleting.
Aug 26 20:51:37 user nova-compute[73476]: INFO nova.compute.manager [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 26 20:51:37 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:38 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:38 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Took 0.79 seconds to deallocate network for instance.
Aug 26 20:51:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:51:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.692s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:39 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Deleted allocations for instance 7f2e574f-a47c-45dc-9261-14de64d5ac7b
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-75a8239d-1003-4fd3-8625-71ee2388d05c tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "7f2e574f-a47c-45dc-9261-14de64d5ac7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.069s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received event network-vif-plugged-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] No waiting events found dispatching network-vif-plugged-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:39 user nova-compute[73476]: WARNING nova.compute.manager [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received unexpected event network-vif-plugged-e016713d-e390-4c42-b097-4907edc7ba6e for instance with vm_state building and task_state spawning.
Aug 26 20:51:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Received event network-vif-deleted-31732c2a-94a0-4be3-b5f5-fbb1488b7161 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received event network-vif-plugged-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] No waiting events found dispatching network-vif-plugged-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:39 user nova-compute[73476]: WARNING nova.compute.manager [req-df662d98-4078-4ecf-b51b-e838c27322ef req-3a2cfef1-e40d-4933-b66c-efb647bff974 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received unexpected event network-vif-plugged-e016713d-e390-4c42-b097-4907edc7ba6e for instance with vm_state building and task_state spawning.
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083100.1996372, ef7f0adb-9324-43ac-b3b7-593900b1576f => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:51:40 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] VM Resumed (Lifecycle Event)
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:51:40 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Instance spawned successfully.
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:51:40 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083100.2002642, ef7f0adb-9324-43ac-b3b7-593900b1576f => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:51:40 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] VM Started (Lifecycle Event)
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:51:40 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:40 user nova-compute[73476]: INFO nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Took 7.07 seconds to spawn the instance on the hypervisor.
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:51:40 user nova-compute[73476]: INFO nova.compute.manager [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Took 8.17 seconds to build instance.
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9faadc7f-27d8-4604-8dc2-0e05368f40e8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.267s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:43 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:51:43 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=7008MB free_disk=25.260154724121094GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ba24bae1-d608-41dd-b928-fad3ba415cc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 6de9ed93-5d15-49cc-82fd-f4822fae54af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1dddc689-a053-46d4-a29e-52c8fe78c76d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ed515d2d-7ad6-48bb-b353-abc4e620156c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ef7f0adb-9324-43ac-b3b7-593900b1576f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-3ec5c438-aeeb-4dfe-81d2-42b7a6fb48ba req-98b4cf2f-40dc-4c03-a70e-a92abc3d01b9 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-3ec5c438-aeeb-4dfe-81d2-42b7a6fb48ba req-98b4cf2f-40dc-4c03-a70e-a92abc3d01b9 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing instance network info cache due to event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3ec5c438-aeeb-4dfe-81d2-42b7a6fb48ba req-98b4cf2f-40dc-4c03-a70e-a92abc3d01b9 service nova] Acquiring lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3ec5c438-aeeb-4dfe-81d2-42b7a6fb48ba req-98b4cf2f-40dc-4c03-a70e-a92abc3d01b9 service nova] Acquired lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-3ec5c438-aeeb-4dfe-81d2-42b7a6fb48ba req-98b4cf2f-40dc-4c03-a70e-a92abc3d01b9 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:51:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:44 user nova-compute[73476]: INFO nova.compute.manager [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Shelve offloading
Aug 26 20:51:44 user nova-compute[73476]: DEBUG nova.network.neutron [req-3ec5c438-aeeb-4dfe-81d2-42b7a6fb48ba req-98b4cf2f-40dc-4c03-a70e-a92abc3d01b9 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updated VIF entry in instance network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG nova.network.neutron [req-3ec5c438-aeeb-4dfe-81d2-42b7a6fb48ba req-98b4cf2f-40dc-4c03-a70e-a92abc3d01b9 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating instance_info_cache with network_info: [{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3ec5c438-aeeb-4dfe-81d2-42b7a6fb48ba req-98b4cf2f-40dc-4c03-a70e-a92abc3d01b9 service nova] Releasing lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:51:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:51:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:51:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:51:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:51:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:45 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Instance destroyed successfully.
Aug 26 20:51:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:51:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:51:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquired lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:51:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-unplugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] No waiting events found dispatching network-vif-unplugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:46 user nova-compute[73476]: WARNING nova.compute.manager [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received unexpected event network-vif-unplugged-d1598316-d7b5-4f58-947f-bee401d27b41 for instance with vm_state active and task_state shelving.
Aug 26 20:51:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] No waiting events found dispatching network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:51:46 user nova-compute[73476]: WARNING nova.compute.manager [req-1a7647af-db85-4eba-a6bd-23add25016a9 req-1bcd05c9-0a4c-4b8f-9cdd-2f1f48ab5734 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received unexpected event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 for instance with vm_state active and task_state shelving.
Aug 26 20:51:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Updating instance_info_cache with network_info: [{"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating instance_info_cache with network_info: [{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Releasing lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:51:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Instance destroyed successfully.
Aug 26 20:51:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lazy-loading 'resources' on Instance uuid 6de9ed93-5d15-49cc-82fd-f4822fae54af {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1052320475',display_name='tempest-TestShelveInstance-server-1052320475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1052320475',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9cneXgwenfoYbuZN8VdIjbq4P2M0guz+16jiyOigb8AgEqLxTm4bpfx8QdV/+zvdA3MHfUK2i4KW0nXA6NtKFaCQ0eZGPQQtLl65fp1vrWGC50VSojhGKAJ/OwKPFgOA==',key_name='tempest-TestShelveInstance-1851856693',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6d618e1c9c4d42bb6572b5dcc2596a',ramdisk_id='',reservation_id='r-h4v8vnt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1238211530',owner_user_name='tempest-TestShelveInstance-1238211530-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:50:12Z,user_data=None,user_id='c28d237e1730497f9b425a1b9bb1aaf5',uuid=6de9ed93-5d15-49cc-82fd-f4822fae54af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converting VIF {"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_vif [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1598316-d7, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:47 user nova-compute[73476]: INFO os_vif [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7')
Aug 26 20:51:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYQgzvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:51:47 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f537d-4639-4830-8c79-0a29c5da4dae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fa0f97-2b2a-4fa4-a899-495a14b3205e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:47 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:47 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:51:47 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:47 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:47 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:47 user nova-compute[73476]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:51:47 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:47 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02ddea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b'): ({'sde'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Removing single pathed devices sde {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ce88de-3a9e-46e7-b273-0530cb990130]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f37dd19-98b9-4f01-b1d7-ddfe8fd70f51]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Flushing IO for device /dev/sde {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cecdd00-9e8e-4b43-8f7c-fc4bc93cc9c9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceafff6-7d19-467c-8b96-7deff80b8dcc]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1334d88-50d1-4ed8-8973-7b454e81b108]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[944991f2-3f7c-4979-9af4-4b942cb4f54d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260]
Aug 26 20:51:47 user nova-compute[73476]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260] successful.
Aug 26 20:51:47 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a45f56-39cf-41a1-8731-8c0958d3a5b7]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] <== disconnect_volume: return (301ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:51:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:51:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Deleting instance files /opt/stack/data/nova/instances/6de9ed93-5d15-49cc-82fd-f4822fae54af_del
Aug 26 20:51:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Deletion of /opt/stack/data/nova/instances/6de9ed93-5d15-49cc-82fd-f4822fae54af_del complete
Aug 26 20:51:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-89e88b0d-f44e-47d2-aa8d-da1f71eee672 req-885f7b4a-bd90-4cca-82ec-cc56237f71ad service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-89e88b0d-f44e-47d2-aa8d-da1f71eee672 req-885f7b4a-bd90-4cca-82ec-cc56237f71ad service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing instance network info cache due to event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-89e88b0d-f44e-47d2-aa8d-da1f71eee672 req-885f7b4a-bd90-4cca-82ec-cc56237f71ad service nova] Acquiring lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-89e88b0d-f44e-47d2-aa8d-da1f71eee672 req-885f7b4a-bd90-4cca-82ec-cc56237f71ad service nova] Acquired lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-89e88b0d-f44e-47d2-aa8d-da1f71eee672 req-885f7b4a-bd90-4cca-82ec-cc56237f71ad service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:51:48 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Deleted allocations for instance 6de9ed93-5d15-49cc-82fd-f4822fae54af
Aug 26 20:51:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG nova.objects.instance [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lazy-loading 'numa_topology' on Instance uuid 6de9ed93-5d15-49cc-82fd-f4822fae54af {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG nova.objects.base [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Object Instance<6de9ed93-5d15-49cc-82fd-f4822fae54af> lazy-loaded attributes: resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-89e88b0d-f44e-47d2-aa8d-da1f71eee672 req-885f7b4a-bd90-4cca-82ec-cc56237f71ad service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updated VIF entry in instance network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-89e88b0d-f44e-47d2-aa8d-da1f71eee672 req-885f7b4a-bd90-4cca-82ec-cc56237f71ad service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating instance_info_cache with network_info: [{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": null, "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd1598316-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-89e88b0d-f44e-47d2-aa8d-da1f71eee672 req-885f7b4a-bd90-4cca-82ec-cc56237f71ad service nova] Releasing lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:51:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85d18ecf-d42e-42c3-b89c-37bb6fab8e6a tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.459s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:51:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:51:51 user nova-compute[73476]: INFO nova.compute.manager [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] instance snapshotting
Aug 26 20:51:51 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Beginning live snapshot process
Aug 26 20:51:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json -f qcow2 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json -f qcow2 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.176s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsgdsbhnq/92f4d2cda7ff42808dcd9e0b18517f01.delta 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsgdsbhnq/92f4d2cda7ff42808dcd9e0b18517f01.delta 1073741824" returned: 0 in 0.053s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 20:51:52 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083097.495435, 7f2e574f-a47c-45dc-9261-14de64d5ac7b => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:51:52 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] VM Stopped (Lifecycle Event)
Aug 26 20:51:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-96ff0caf-f7b2-49d3-8654-7fc9a945cd3e None None] [instance: 7f2e574f-a47c-45dc-9261-14de64d5ac7b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:51:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:51:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:51:53 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 20:51:53 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:51:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsgdsbhnq/92f4d2cda7ff42808dcd9e0b18517f01.delta /opt/stack/data/nova/instances/snapshots/tmpsgdsbhnq/92f4d2cda7ff42808dcd9e0b18517f01 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsgdsbhnq/92f4d2cda7ff42808dcd9e0b18517f01.delta /opt/stack/data/nova/instances/snapshots/tmpsgdsbhnq/92f4d2cda7ff42808dcd9e0b18517f01" returned: 0 in 0.677s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Snapshot extracted, beginning image upload
Aug 26 20:51:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:51:56 user nova-compute[73476]: INFO nova.compute.manager [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Detaching volume e6ecb1c9-be89-4bb3-a1b1-db256c5606b9
Aug 26 20:51:56 user nova-compute[73476]: INFO nova.virt.block_device [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Attempting to driver detach volume e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 from mountpoint /dev/vdb
Aug 26 20:51:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Attempting to detach device vdb from instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:51:56 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:51:56 user nova-compute[73476]:   <source dev="/dev/sdg"/>
Aug 26 20:51:56 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:51:56 user nova-compute[73476]:   <serial>e6ecb1c9-be89-4bb3-a1b1-db256c5606b9</serial>
Aug 26 20:51:56 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:51:56 user nova-compute[73476]: </disk>
Aug 26 20:51:56 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:51:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully detached device vdb from instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 from the persistent domain config.
Aug 26 20:51:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:51:56 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:51:56 user nova-compute[73476]:   <source dev="/dev/sdg"/>
Aug 26 20:51:56 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:51:56 user nova-compute[73476]:   <serial>e6ecb1c9-be89-4bb3-a1b1-db256c5606b9</serial>
Aug 26 20:51:56 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:51:56 user nova-compute[73476]: </disk>
Aug 26 20:51:56 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083116.763669, 820f7ca5-8bf5-494d-8dae-b0ee3431f156 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:51:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully detached device vdb from instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 from the live domain config.
Aug 26 20:51:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHpOoNWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:51:56 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07225b3-a3a2-4b59-8f04-e25fb38a8e56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a28517-8a40-46e5-b7ae-ae5b53a9fe16]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:56 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:56 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:51:56 user nova-compute[73476]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 (non-flash)
Aug 26 20:51:56 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:51:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d01f63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9'): ({'sdg'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Removing single pathed devices sdg {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff318f8e-b1e5-45b2-921f-4c7d636af7c6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce649fe4-9fab-45d5-8fb1-16c545ebaede]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flushing IO for device /dev/sdg {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c020c194-3405-42c2-a7b1-679a526f4f3b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.064s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[890755b9-a849-4d4c-92a9-2a235556bb64]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] SCSI volumes sdg have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:51:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e38c58-8f69-4e00-b97f-ea9b771aa325]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9281ff-bea7-47d0-ae60-0979ef3456b2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9, portal: 172.16.0.220,3260]
Aug 26 20:51:57 user nova-compute[73476]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9, portal: 172.16.0.220,3260] successful.
Aug 26 20:51:57 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ecb1c9-be89-4bb3-a1b1-db256c5606b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c109801-6c5f-47c8-a13f-3177206ba442]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] <== disconnect_volume: return (327ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:51:57 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Snapshot image upload complete
Aug 26 20:51:57 user nova-compute[73476]: INFO nova.compute.manager [None req-021e7d2c-ab1d-4b18-a0c1-3378b6da21df tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Took 5.61 seconds to snapshot the instance on the hypervisor.
Aug 26 20:51:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG nova.objects.instance [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'flavor' on Instance uuid 820f7ca5-8bf5-494d-8dae-b0ee3431f156 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:51:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-116db9eb-a5b7-4c32-a5f3-94c0a25d1e4b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.690s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:00 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083105.408174, 6de9ed93-5d15-49cc-82fd-f4822fae54af => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:52:00 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] VM Stopped (Lifecycle Event)
Aug 26 20:52:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9b00713e-f5df-4e9f-b012-f5dcb13e3b3b None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:52:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-d152abfc-9045-4323-840f-8a4828ac3770 req-6598999b-8f90-4937-b9d9-46e7853159d9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-changed-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-d152abfc-9045-4323-840f-8a4828ac3770 req-6598999b-8f90-4937-b9d9-46e7853159d9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Refreshing instance network info cache due to event network-changed-3c33176d-b04b-4fcd-9e30-e2b9799af0c4. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:52:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d152abfc-9045-4323-840f-8a4828ac3770 req-6598999b-8f90-4937-b9d9-46e7853159d9 service nova] Acquiring lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:52:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d152abfc-9045-4323-840f-8a4828ac3770 req-6598999b-8f90-4937-b9d9-46e7853159d9 service nova] Acquired lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:52:05 user nova-compute[73476]: DEBUG nova.network.neutron [req-d152abfc-9045-4323-840f-8a4828ac3770 req-6598999b-8f90-4937-b9d9-46e7853159d9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Refreshing network info cache for port 3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'flavor' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:06 user nova-compute[73476]: INFO nova.compute.manager [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Attaching volume 00045f26-cd8a-413c-b733-33ea0beddaf3 to /dev/vdb
Aug 26 20:52:06 user nova-compute[73476]: DEBUG os_brick.utils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f96e6b-2f50-4976-a490-6e54def3357e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f3dbfd-5102-4605-aef2-93804caa2b84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba875c5d-9a3b-40b5-be47-0fa9abb5a6c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c5e187-3d5f-4b1e-93ef-75ac38811378]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:52:06 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[894ae4c8-2e18-4f7c-ac91-a01bfd48c046]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG os_brick.utils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating existing volume attachment record: 5eae2b27-63a2-4a9b-9dc8-5fa74b3c03fd {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG nova.network.neutron [req-d152abfc-9045-4323-840f-8a4828ac3770 req-6598999b-8f90-4937-b9d9-46e7853159d9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updated VIF entry in instance network info cache for port 3c33176d-b04b-4fcd-9e30-e2b9799af0c4. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG nova.network.neutron [req-d152abfc-9045-4323-840f-8a4828ac3770 req-6598999b-8f90-4937-b9d9-46e7853159d9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating instance_info_cache with network_info: [{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d152abfc-9045-4323-840f-8a4828ac3770 req-6598999b-8f90-4937-b9d9-46e7853159d9 service nova] Releasing lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:52:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JosxYatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:52:18 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:52:18 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:52:18 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[78db0073-4bed-4223-b895-0b559326aae5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:52:18 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0799e740-6a31-4649-b7f9-5174f24d2c4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3] added
Aug 26 20:52:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b778ddee-ffaa-4e0f-983f-2635c042df11]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d79020-20ea-4d21-917b-2c9a1da7984f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JosxYatR {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JosxYatR" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[245a966d-a49e-44f6-b42b-b712cf53cc12]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JosxYatR'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2164bf08-4a2f-4091-a9ef-bf3df576fd1e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aa12fa-e8b0-4040-bdb8-73a07b7b1768]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:52:18 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:52:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:52:18 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:52:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99f7276-4ef0-45d5-9fb5-9112dedb15fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3, portal: 172.16.0.220,3260]
Aug 26 20:52:18 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3, portal: 172.16.0.220,3260] successful.
Aug 26 20:52:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa24b19f-6968-4483-a1e9-902ef9cdf3a9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ee3b5c-3981-47e1-88e6-491563319bf7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:52:18 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:52:18 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:52:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:52:18 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:52:18 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:52:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b3fcef-1f95-41b6-a9ee-e171121a2e93]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:52:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JosxYatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:52:19 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:52:19 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23934643937303264', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:52:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934643937303264', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:52:19 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'flavor' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:52:19 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:52:19 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 20:52:19 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:52:19 user nova-compute[73476]:   <serial>00045f26-cd8a-413c-b733-33ea0beddaf3</serial>
Aug 26 20:52:19 user nova-compute[73476]: </disk>
Aug 26 20:52:19 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:52:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:52:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:52:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No VIF found with MAC fa:16:3e:df:c4:5d, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:52:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4acb5d8d-400c-4b3f-b808-d135a9010c49 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.836s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:20 user nova-compute[73476]: INFO nova.compute.manager [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Rescuing
Aug 26 20:52:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:52:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquired lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:52:20 user nova-compute[73476]: DEBUG nova.network.neutron [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG nova.network.neutron [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating instance_info_cache with network_info: [{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Releasing lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-b1d34efc-9ae9-4a54-923e-9c4025954857 req-2a85823e-1cb4-4aae-93ab-1847ec8b5e3c service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-unplugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b1d34efc-9ae9-4a54-923e-9c4025954857 req-2a85823e-1cb4-4aae-93ab-1847ec8b5e3c service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b1d34efc-9ae9-4a54-923e-9c4025954857 req-2a85823e-1cb4-4aae-93ab-1847ec8b5e3c service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b1d34efc-9ae9-4a54-923e-9c4025954857 req-2a85823e-1cb4-4aae-93ab-1847ec8b5e3c service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-b1d34efc-9ae9-4a54-923e-9c4025954857 req-2a85823e-1cb4-4aae-93ab-1847ec8b5e3c service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-unplugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:21 user nova-compute[73476]: WARNING nova.compute.manager [req-b1d34efc-9ae9-4a54-923e-9c4025954857 req-2a85823e-1cb4-4aae-93ab-1847ec8b5e3c service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-unplugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state active and task_state rescuing.
Aug 26 20:52:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:22 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Instance destroyed successfully.
Aug 26 20:52:22 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Attempting rescue
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73476) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Instance directory exists: not creating {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 20:52:22 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Creating image(s)
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.instance [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue" returned: 0 in 0.057s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.instance [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'migration_context' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.base [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<ed515d2d-7ad6-48bb-b353-abc4e620156c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Start _get_guest_xml network_info=[{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "vif_mac": "fa:16:3e:df:c4:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.instance [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'resources' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.base [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<ed515d2d-7ad6-48bb-b353-abc4e620156c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.instance [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'numa_topology' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.base [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<ed515d2d-7ad6-48bb-b353-abc4e620156c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:52:22 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:22 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.instance [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.base [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<ed515d2d-7ad6-48bb-b353-abc4e620156c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-498578521',display_name='tempest-ServerRescueNegativeTestJSON-server-498578521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-498578521',id=24,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrYc/eo42C+qeHxgT+p6TK6jOtky3Pkwr7yvC+k8KAA3Fdpx5iwJgpsdD1am7zb+G0Wb0G2AiVReR/rWqcojnZEmPVzWbjoLQ2gzQtDRr1lW7FV6rEkvFmKMKX03TRu1g==',key_name='tempest-keypair-113143643',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:50:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-63tr0wlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=ed515d2d-7ad6-48bb-b353-abc4e620156c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "vif_mac": "fa:16:3e:df:c4:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "vif_mac": "fa:16:3e:df:c4:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=3c33176d-b04b-4fcd-9e30-e2b9799af0c4,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33176d-b0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.instance [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'pci_devices' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.objects.base [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Object Instance<ed515d2d-7ad6-48bb-b353-abc4e620156c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:52:22 user nova-compute[73476]:   <uuid>ed515d2d-7ad6-48bb-b353-abc4e620156c</uuid>
Aug 26 20:52:22 user nova-compute[73476]:   <name>instance-00000018</name>
Aug 26 20:52:22 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:52:22 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:52:22 user nova-compute[73476]:   <metadata>
Aug 26 20:52:22 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:52:22 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:52:22 user nova-compute[73476]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-498578521</nova:name>
Aug 26 20:52:22 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:52:22</nova:creationTime>
Aug 26 20:52:22 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:52:22 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:52:22 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:52:22 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:52:22 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:52:22 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:52:22 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:52:22 user nova-compute[73476]:       <nova:owner>
Aug 26 20:52:22 user nova-compute[73476]:         <nova:user uuid="eb63707c9d734bf5b1d1bb20162e3204">tempest-ServerRescueNegativeTestJSON-552908196-project-member</nova:user>
Aug 26 20:52:22 user nova-compute[73476]:         <nova:project uuid="c713d9f0cc5f4dd7a8629ba1b27e72f0">tempest-ServerRescueNegativeTestJSON-552908196</nova:project>
Aug 26 20:52:22 user nova-compute[73476]:       </nova:owner>
Aug 26 20:52:22 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:52:22 user nova-compute[73476]:       <nova:ports>
Aug 26 20:52:22 user nova-compute[73476]:         <nova:port uuid="3c33176d-b04b-4fcd-9e30-e2b9799af0c4">
Aug 26 20:52:22 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 20:52:22 user nova-compute[73476]:         </nova:port>
Aug 26 20:52:22 user nova-compute[73476]:       </nova:ports>
Aug 26 20:52:22 user nova-compute[73476]:     </nova:instance>
Aug 26 20:52:22 user nova-compute[73476]:   </metadata>
Aug 26 20:52:22 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:52:22 user nova-compute[73476]:     <system>
Aug 26 20:52:22 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:52:22 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:52:22 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:52:22 user nova-compute[73476]:       <entry name="serial">ed515d2d-7ad6-48bb-b353-abc4e620156c</entry>
Aug 26 20:52:22 user nova-compute[73476]:       <entry name="uuid">ed515d2d-7ad6-48bb-b353-abc4e620156c</entry>
Aug 26 20:52:22 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:52:22 user nova-compute[73476]:     </system>
Aug 26 20:52:22 user nova-compute[73476]:   </sysinfo>
Aug 26 20:52:22 user nova-compute[73476]:   <os>
Aug 26 20:52:22 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:52:22 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:52:22 user nova-compute[73476]:   </os>
Aug 26 20:52:22 user nova-compute[73476]:   <features>
Aug 26 20:52:22 user nova-compute[73476]:     <acpi/>
Aug 26 20:52:22 user nova-compute[73476]:     <apic/>
Aug 26 20:52:22 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:52:22 user nova-compute[73476]:   </features>
Aug 26 20:52:22 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:52:22 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:52:22 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:52:22 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:52:22 user nova-compute[73476]:   </clock>
Aug 26 20:52:22 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:52:22 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:52:22 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:52:22 user nova-compute[73476]:   </cpu>
Aug 26 20:52:22 user nova-compute[73476]:   <devices>
Aug 26 20:52:22 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:52:22 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:52:22 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue"/>
Aug 26 20:52:22 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:52:22 user nova-compute[73476]:     </disk>
Aug 26 20:52:22 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:52:22 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:52:22 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk"/>
Aug 26 20:52:22 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:52:22 user nova-compute[73476]:     </disk>
Aug 26 20:52:22 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:52:22 user nova-compute[73476]:       <mac address="fa:16:3e:df:c4:5d"/>
Aug 26 20:52:22 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:52:22 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:52:22 user nova-compute[73476]:       <target dev="tap3c33176d-b0"/>
Aug 26 20:52:22 user nova-compute[73476]:     </interface>
Aug 26 20:52:22 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:52:22 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/console.log" append="off"/>
Aug 26 20:52:22 user nova-compute[73476]:     </serial>
Aug 26 20:52:22 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:52:22 user nova-compute[73476]:     <video>
Aug 26 20:52:22 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:52:22 user nova-compute[73476]:     </video>
Aug 26 20:52:22 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:52:22 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:52:22 user nova-compute[73476]:     </rng>
Aug 26 20:52:22 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:52:22 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:52:22 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:52:22 user nova-compute[73476]:     </memballoon>
Aug 26 20:52:22 user nova-compute[73476]:   </devices>
Aug 26 20:52:22 user nova-compute[73476]: </domain>
Aug 26 20:52:22 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:52:22 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Instance destroyed successfully.
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:52:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] No VIF found with MAC fa:16:3e:df:c4:5d, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-0b1075cf-6310-44df-9c98-4aa2739abec6 req-583913c1-01af-4fed-8908-a34ad3d5314c service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0b1075cf-6310-44df-9c98-4aa2739abec6 req-583913c1-01af-4fed-8908-a34ad3d5314c service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0b1075cf-6310-44df-9c98-4aa2739abec6 req-583913c1-01af-4fed-8908-a34ad3d5314c service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0b1075cf-6310-44df-9c98-4aa2739abec6 req-583913c1-01af-4fed-8908-a34ad3d5314c service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-0b1075cf-6310-44df-9c98-4aa2739abec6 req-583913c1-01af-4fed-8908-a34ad3d5314c service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:24 user nova-compute[73476]: WARNING nova.compute.manager [req-0b1075cf-6310-44df-9c98-4aa2739abec6 req-583913c1-01af-4fed-8908-a34ad3d5314c service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state active and task_state rescuing.
Aug 26 20:52:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:26 user nova-compute[73476]: WARNING nova.compute.manager [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state active and task_state rescuing.
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:26 user nova-compute[73476]: WARNING nova.compute.manager [req-af4f7355-db49-4675-8b0f-007fb6b65742 req-4fff6adf-55ac-4b54-b855-4ab25cd56644 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state active and task_state rescuing.
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for ed515d2d-7ad6-48bb-b353-abc4e620156c due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083146.6095016, ed515d2d-7ad6-48bb-b353-abc4e620156c => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:52:26 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] VM Resumed (Lifecycle Event)
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-befc3c63-5de0-4691-9826-c034b7021d4f tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:52:26 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083146.6137533, ed515d2d-7ad6-48bb-b353-abc4e620156c => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:52:26 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] VM Started (Lifecycle Event)
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:52:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:52:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:52:29 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73476) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 20:52:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:32 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:52:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:32 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:52:32 user nova-compute[73476]: INFO nova.compute.claims [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Claim successful on node user
Aug 26 20:52:32 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:52:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:52:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG nova.policy [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '818cdd5f2ecf42739eb1d1d44c2d78e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0bf9d46b5447a495d0cf45071e0c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:52:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Creating image(s)
Aug 26 20:52:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "/opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "/opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "/opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "8aee39c8759c024ac2bb14219dd048759fed1771" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "8aee39c8759c024ac2bb14219dd048759fed1771" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771.part --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG nova.virt.images [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] 645d413e-b0aa-48ea-8f77-6a0ab2fd809d was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771.part /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Successfully created port: bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771.part /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771.converted" returned: 0 in 0.223s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "8aee39c8759c024ac2bb14219dd048759fed1771" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.216s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771 --force-share --output=json" returned: 0 in 0.239s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "8aee39c8759c024ac2bb14219dd048759fed1771" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "8aee39c8759c024ac2bb14219dd048759fed1771" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771 --force-share --output=json" returned: 0 in 0.227s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771,backing_fmt=raw /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771,backing_fmt=raw /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk 1073741824" returned: 0 in 0.065s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "8aee39c8759c024ac2bb14219dd048759fed1771" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771 --force-share --output=json" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Successfully updated port: bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquired lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Cannot resize image /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Ensure instance console log exists: /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:35 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.compute.manager [req-2415627c-0fa7-46cf-a32b-0dc110408125 req-dc0e0e41-6939-4803-b613-800b92926826 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.compute.manager [req-2415627c-0fa7-46cf-a32b-0dc110408125 req-dc0e0e41-6939-4803-b613-800b92926826 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing instance network info cache due to event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2415627c-0fa7-46cf-a32b-0dc110408125 req-dc0e0e41-6939-4803-b613-800b92926826 service nova] Acquiring lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updating instance_info_cache with network_info: [{"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Releasing lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Instance network_info: |[{"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2415627c-0fa7-46cf-a32b-0dc110408125 req-dc0e0e41-6939-4803-b613-800b92926826 service nova] Acquired lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.network.neutron [req-2415627c-0fa7-46cf-a32b-0dc110408125 req-dc0e0e41-6939-4803-b613-800b92926826 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Start _get_guest_xml network_info=[{"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:52:28Z,direct_url=<?>,disk_format='qcow2',id=645d413e-b0aa-48ea-8f77-6a0ab2fd809d,min_disk=0,min_ram=0,name='tempest-scenario-img--281862922',owner='1c0bf9d46b5447a495d0cf45071e0c27',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:52:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '645d413e-b0aa-48ea-8f77-6a0ab2fd809d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:52:36 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:36 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:52:28Z,direct_url=<?>,disk_format='qcow2',id=645d413e-b0aa-48ea-8f77-6a0ab2fd809d,min_disk=0,min_ram=0,name='tempest-scenario-img--281862922',owner='1c0bf9d46b5447a495d0cf45071e0c27',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:52:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-700244707',display_name='tempest-TestMinimumBasicScenario-server-700244707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-700244707',id=26,image_ref='645d413e-b0aa-48ea-8f77-6a0ab2fd809d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNjFbkYrxENkDzGpIFk6wJAxo8Wr5yaLnE97Q9eDlCG8qiNOyPsVTHQdiTnq3oFuv7VNLvgUBazCv9lKIt1eTovozcK1vTIu8XfDKc74313fAOcknwPDyg39N4d6zBaEQ==',key_name='tempest-TestMinimumBasicScenario-1681480724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c0bf9d46b5447a495d0cf45071e0c27',ramdisk_id='',reservation_id='r-4efvn902',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='645d413e-b0aa-48ea-8f77-6a0ab2fd809d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1097465264',owner_user_name='tempest-TestMinimumBasicScenario-1097465264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:52:34Z,user_data=None,user_id='818cdd5f2ecf42739eb1d1d44c2d78e5',uuid=d40cfba2-b7b6-4e80-947d-7d7dc031b2a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converting VIF {"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:1d,bridge_name='br-int',has_traffic_filtering=True,id=bfeb0f7e-f5b7-497e-a0f4-75d7b5263923,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeb0f7e-f5') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'pci_devices' on Instance uuid d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:52:36 user nova-compute[73476]:   <uuid>d40cfba2-b7b6-4e80-947d-7d7dc031b2a5</uuid>
Aug 26 20:52:36 user nova-compute[73476]:   <name>instance-0000001a</name>
Aug 26 20:52:36 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:52:36 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:52:36 user nova-compute[73476]:   <metadata>
Aug 26 20:52:36 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:52:36 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:52:36 user nova-compute[73476]:       <nova:name>tempest-TestMinimumBasicScenario-server-700244707</nova:name>
Aug 26 20:52:36 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:52:36</nova:creationTime>
Aug 26 20:52:36 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:52:36 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:52:36 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:52:36 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:52:36 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:52:36 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:52:36 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:52:36 user nova-compute[73476]:       <nova:owner>
Aug 26 20:52:36 user nova-compute[73476]:         <nova:user uuid="818cdd5f2ecf42739eb1d1d44c2d78e5">tempest-TestMinimumBasicScenario-1097465264-project-member</nova:user>
Aug 26 20:52:36 user nova-compute[73476]:         <nova:project uuid="1c0bf9d46b5447a495d0cf45071e0c27">tempest-TestMinimumBasicScenario-1097465264</nova:project>
Aug 26 20:52:36 user nova-compute[73476]:       </nova:owner>
Aug 26 20:52:36 user nova-compute[73476]:       <nova:root type="image" uuid="645d413e-b0aa-48ea-8f77-6a0ab2fd809d"/>
Aug 26 20:52:36 user nova-compute[73476]:       <nova:ports>
Aug 26 20:52:36 user nova-compute[73476]:         <nova:port uuid="bfeb0f7e-f5b7-497e-a0f4-75d7b5263923">
Aug 26 20:52:36 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 20:52:36 user nova-compute[73476]:         </nova:port>
Aug 26 20:52:36 user nova-compute[73476]:       </nova:ports>
Aug 26 20:52:36 user nova-compute[73476]:     </nova:instance>
Aug 26 20:52:36 user nova-compute[73476]:   </metadata>
Aug 26 20:52:36 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:52:36 user nova-compute[73476]:     <system>
Aug 26 20:52:36 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:52:36 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:52:36 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:52:36 user nova-compute[73476]:       <entry name="serial">d40cfba2-b7b6-4e80-947d-7d7dc031b2a5</entry>
Aug 26 20:52:36 user nova-compute[73476]:       <entry name="uuid">d40cfba2-b7b6-4e80-947d-7d7dc031b2a5</entry>
Aug 26 20:52:36 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:52:36 user nova-compute[73476]:     </system>
Aug 26 20:52:36 user nova-compute[73476]:   </sysinfo>
Aug 26 20:52:36 user nova-compute[73476]:   <os>
Aug 26 20:52:36 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:52:36 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:52:36 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:52:36 user nova-compute[73476]:   </os>
Aug 26 20:52:36 user nova-compute[73476]:   <features>
Aug 26 20:52:36 user nova-compute[73476]:     <acpi/>
Aug 26 20:52:36 user nova-compute[73476]:     <apic/>
Aug 26 20:52:36 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:52:36 user nova-compute[73476]:   </features>
Aug 26 20:52:36 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:52:36 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:52:36 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:52:36 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:52:36 user nova-compute[73476]:   </clock>
Aug 26 20:52:36 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:52:36 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:52:36 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:52:36 user nova-compute[73476]:   </cpu>
Aug 26 20:52:36 user nova-compute[73476]:   <devices>
Aug 26 20:52:36 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:52:36 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:52:36 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk"/>
Aug 26 20:52:36 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:52:36 user nova-compute[73476]:     </disk>
Aug 26 20:52:36 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:52:36 user nova-compute[73476]:       <mac address="fa:16:3e:e5:38:1d"/>
Aug 26 20:52:36 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:52:36 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:52:36 user nova-compute[73476]:       <target dev="tapbfeb0f7e-f5"/>
Aug 26 20:52:36 user nova-compute[73476]:     </interface>
Aug 26 20:52:36 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:52:36 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/console.log" append="off"/>
Aug 26 20:52:36 user nova-compute[73476]:     </serial>
Aug 26 20:52:36 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:52:36 user nova-compute[73476]:     <video>
Aug 26 20:52:36 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:52:36 user nova-compute[73476]:     </video>
Aug 26 20:52:36 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:52:36 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:52:36 user nova-compute[73476]:     </rng>
Aug 26 20:52:36 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:52:36 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:52:36 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:52:36 user nova-compute[73476]:     </memballoon>
Aug 26 20:52:36 user nova-compute[73476]:   </devices>
Aug 26 20:52:36 user nova-compute[73476]: </domain>
Aug 26 20:52:36 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-700244707',display_name='tempest-TestMinimumBasicScenario-server-700244707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-700244707',id=26,image_ref='645d413e-b0aa-48ea-8f77-6a0ab2fd809d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNjFbkYrxENkDzGpIFk6wJAxo8Wr5yaLnE97Q9eDlCG8qiNOyPsVTHQdiTnq3oFuv7VNLvgUBazCv9lKIt1eTovozcK1vTIu8XfDKc74313fAOcknwPDyg39N4d6zBaEQ==',key_name='tempest-TestMinimumBasicScenario-1681480724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c0bf9d46b5447a495d0cf45071e0c27',ramdisk_id='',reservation_id='r-4efvn902',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='645d413e-b0aa-48ea-8f77-6a0ab2fd809d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1097465264',owner_user_name='tempest-TestMinimumBasicScenario-1097465264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:52:34Z,user_data=None,user_id='818cdd5f2ecf42739eb1d1d44c2d78e5',uuid=d40cfba2-b7b6-4e80-947d-7d7dc031b2a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converting VIF {"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:1d,bridge_name='br-int',has_traffic_filtering=True,id=bfeb0f7e-f5b7-497e-a0f4-75d7b5263923,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeb0f7e-f5') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG os_vif [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:1d,bridge_name='br-int',has_traffic_filtering=True,id=bfeb0f7e-f5b7-497e-a0f4-75d7b5263923,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeb0f7e-f5') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfeb0f7e-f5, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfeb0f7e-f5, col_values=(('external_ids', {'iface-id': 'bfeb0f7e-f5b7-497e-a0f4-75d7b5263923', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:38:1d', 'vm-uuid': 'd40cfba2-b7b6-4e80-947d-7d7dc031b2a5'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:36 user nova-compute[73476]: INFO os_vif [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:1d,bridge_name='br-int',has_traffic_filtering=True,id=bfeb0f7e-f5b7-497e-a0f4-75d7b5263923,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeb0f7e-f5')
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No VIF found with MAC fa:16:3e:e5:38:1d, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.network.neutron [req-2415627c-0fa7-46cf-a32b-0dc110408125 req-dc0e0e41-6939-4803-b613-800b92926826 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updated VIF entry in instance network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG nova.network.neutron [req-2415627c-0fa7-46cf-a32b-0dc110408125 req-dc0e0e41-6939-4803-b613-800b92926826 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updating instance_info_cache with network_info: [{"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2415627c-0fa7-46cf-a32b-0dc110408125 req-dc0e0e41-6939-4803-b613-800b92926826 service nova] Releasing lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:38 user nova-compute[73476]: INFO nova.compute.manager [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Terminating instance
Aug 26 20:52:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-7c656dbb-d392-4965-88b9-128fd40c3cb2 req-78c5334a-94d2-4814-8f41-e91e58b50645 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7c656dbb-d392-4965-88b9-128fd40c3cb2 req-78c5334a-94d2-4814-8f41-e91e58b50645 service nova] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7c656dbb-d392-4965-88b9-128fd40c3cb2 req-78c5334a-94d2-4814-8f41-e91e58b50645 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7c656dbb-d392-4965-88b9-128fd40c3cb2 req-78c5334a-94d2-4814-8f41-e91e58b50645 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-7c656dbb-d392-4965-88b9-128fd40c3cb2 req-78c5334a-94d2-4814-8f41-e91e58b50645 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] No waiting events found dispatching network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:38 user nova-compute[73476]: WARNING nova.compute.manager [req-7c656dbb-d392-4965-88b9-128fd40c3cb2 req-78c5334a-94d2-4814-8f41-e91e58b50645 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received unexpected event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 for instance with vm_state building and task_state spawning.
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-8569eb4b-9e8a-41ef-89de-09fe27066252 req-264e954f-e844-4649-ad04-ab9b7952ce5a service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-unplugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8569eb4b-9e8a-41ef-89de-09fe27066252 req-264e954f-e844-4649-ad04-ab9b7952ce5a service nova] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8569eb4b-9e8a-41ef-89de-09fe27066252 req-264e954f-e844-4649-ad04-ab9b7952ce5a service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8569eb4b-9e8a-41ef-89de-09fe27066252 req-264e954f-e844-4649-ad04-ab9b7952ce5a service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-8569eb4b-9e8a-41ef-89de-09fe27066252 req-264e954f-e844-4649-ad04-ab9b7952ce5a service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] No waiting events found dispatching network-vif-unplugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-8569eb4b-9e8a-41ef-89de-09fe27066252 req-264e954f-e844-4649-ad04-ab9b7952ce5a service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-unplugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:52:39 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Instance destroyed successfully.
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lazy-loading 'resources' on Instance uuid ba24bae1-d608-41dd-b928-fad3ba415cc1 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1335220622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1530961728',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwjoJwGNxGs7G8sGWzXNWPaMUrsR51iAkmlUCNqWZds597i69ly8h77pfkK/8WuXPB5E/6x9PUenKX8xpliIZdz/cCEW9R/w6nPEeKQAuV2ko7KXmy5CGuAoPNDGkI3Tg==',key_name='tempest-keypair-999954189',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f1adaa2e9f94156a674b7825b4c7b37',ramdisk_id='',reservation_id='r-mlfz9lcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1323308358',owner_user_name='tempest-ServerActionsV293TestJSON-1323308358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89e2c5481c8d4a5a859f17b8af08626a',uuid=ba24bae1-d608-41dd-b928-fad3ba415cc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converting VIF {"id": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "address": "fa:16:3e:7f:65:fd", "network": {"id": "5e6c0f13-9538-4676-bd3c-0436e262ce09", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-590388205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f1adaa2e9f94156a674b7825b4c7b37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9c5fd68-f9", "ovs_interfaceid": "c9c5fd68-f9ac-4e5b-882d-8dcc870fc942", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_vif [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9c5fd68-f9, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: INFO os_vif [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:65:fd,bridge_name='br-int',has_traffic_filtering=True,id=c9c5fd68-f9ac-4e5b-882d-8dcc870fc942,network=Network(5e6c0f13-9538-4676-bd3c-0436e262ce09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9c5fd68-f9')
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDqHkzZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:52:39 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.038s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a9c4ff-d1e4-46cf-98d2-b60218f78150]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4897614-25b5-48d1-aad2-a8d2fd2097ee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:52:39 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:52:39 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:52:39 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:52:39 user nova-compute[73476]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 (non-flash)
Aug 26 20:52:39 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:52:39 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02b7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c94390-b720-405a-a85c-8e4518f3f65e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.039s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb33358-1e7e-4f7d-95cb-588134e9a0b6]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f293d6a3-7d2f-4160-b1e1-b46b7e7fdcda]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.103s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a118c-23fd-49b9-ae4b-aedcdd89240f]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO47ada1de-db795042be41cbd6', '/dev/disk/by-id/scsi-26462373935303432', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_47ada1de') {{(pid=84820) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf03e260-b337-439b-86f0-e9b37fd9e735]: (4, None) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3c9f12-75c4-48aa-8d94-f3eb43205996]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[278bd7f7-05be-483d-9029-4d8e7732d481]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260]
Aug 26 20:52:39 user nova-compute[73476]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233, portal: 172.16.0.220,3260] successful.
Aug 26 20:52:39 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eef670-6c83-45f8-85af-dc163f4ed233 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d77ab-ca91-438e-a272-6b684bf00b68]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.508s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] <== disconnect_volume: return (514ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:52:39 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Deleting instance files /opt/stack/data/nova/instances/ba24bae1-d608-41dd-b928-fad3ba415cc1_del
Aug 26 20:52:39 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Deletion of /opt/stack/data/nova/instances/ba24bae1-d608-41dd-b928-fad3ba415cc1_del complete
Aug 26 20:52:39 user nova-compute[73476]: INFO nova.compute.manager [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 26 20:52:39 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:52:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Updating instance_info_cache with network_info: [{"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-13e8971f-2d6c-4f8e-b895-411db3554e74" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083160.7357, d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:52:40 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] VM Resumed (Lifecycle Event)
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:52:40 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Instance spawned successfully.
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:52:40 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083160.740292, d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:52:40 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] VM Started (Lifecycle Event)
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:52:40 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-5875461f-ed2e-4eb9-bb7c-3d48a3a62323 req-011ca3e9-b612-435a-a3e0-8f1c6a9481d5 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5875461f-ed2e-4eb9-bb7c-3d48a3a62323 req-011ca3e9-b612-435a-a3e0-8f1c6a9481d5 service nova] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5875461f-ed2e-4eb9-bb7c-3d48a3a62323 req-011ca3e9-b612-435a-a3e0-8f1c6a9481d5 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5875461f-ed2e-4eb9-bb7c-3d48a3a62323 req-011ca3e9-b612-435a-a3e0-8f1c6a9481d5 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-5875461f-ed2e-4eb9-bb7c-3d48a3a62323 req-011ca3e9-b612-435a-a3e0-8f1c6a9481d5 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] No waiting events found dispatching network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:40 user nova-compute[73476]: WARNING nova.compute.manager [req-5875461f-ed2e-4eb9-bb7c-3d48a3a62323 req-011ca3e9-b612-435a-a3e0-8f1c6a9481d5 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received unexpected event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 for instance with vm_state building and task_state spawning.
Aug 26 20:52:40 user nova-compute[73476]: INFO nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Took 7.33 seconds to spawn the instance on the hypervisor.
Aug 26 20:52:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-464d2551-abb6-47f4-8812-ae88d7db7e51 req-4fbe658e-9d40-4652-bd91-8ee2fcf0544e service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-464d2551-abb6-47f4-8812-ae88d7db7e51 req-4fbe658e-9d40-4652-bd91-8ee2fcf0544e service nova] Acquiring lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-464d2551-abb6-47f4-8812-ae88d7db7e51 req-4fbe658e-9d40-4652-bd91-8ee2fcf0544e service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-464d2551-abb6-47f4-8812-ae88d7db7e51 req-4fbe658e-9d40-4652-bd91-8ee2fcf0544e service nova] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-464d2551-abb6-47f4-8812-ae88d7db7e51 req-4fbe658e-9d40-4652-bd91-8ee2fcf0544e service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] No waiting events found dispatching network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:41 user nova-compute[73476]: WARNING nova.compute.manager [req-464d2551-abb6-47f4-8812-ae88d7db7e51 req-4fbe658e-9d40-4652-bd91-8ee2fcf0544e service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received unexpected event network-vif-plugged-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 for instance with vm_state active and task_state deleting.
Aug 26 20:52:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:41 user nova-compute[73476]: INFO nova.compute.manager [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Took 8.74 seconds to build instance.
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2610d2e1-7459-4cd6-824c-411763679c4b tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.879s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:41 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Took 1.70 seconds to deallocate network for instance.
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:42 user nova-compute[73476]: INFO nova.compute.manager [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Took 1.12 seconds to detach 1 volumes for instance.
Aug 26 20:52:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Deleting volume: 60eef670-6c83-45f8-85af-dc163f4ed233 {{(pid=73476) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Refreshing inventories for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Updating ProviderTree inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Refreshing aggregate associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, aggregates: None {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Refreshing trait associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-792436ca-effb-4cd9-a8f4-05b67a3e21e6 req-788fb140-099c-442e-a3b5-6369df66fa0f service nova] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Received event network-vif-deleted-c9c5fd68-f9ac-4e5b-882d-8dcc870fc942 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.015s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:43 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Deleted allocations for instance ba24bae1-d608-41dd-b928-fad3ba415cc1
Aug 26 20:52:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7190cb45-59fb-4db2-b0b1-5c2102b714d3 tempest-ServerActionsV293TestJSON-1323308358 tempest-ServerActionsV293TestJSON-1323308358-project-member] Lock "ba24bae1-d608-41dd-b928-fad3ba415cc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.770s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:46 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:46 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:46 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=7259MB free_disk=25.173988342285156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:46 user nova-compute[73476]: INFO nova.compute.manager [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Terminating instance
Aug 26 20:52:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:52:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1dddc689-a053-46d4-a29e-52c8fe78c76d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ed515d2d-7ad6-48bb-b353-abc4e620156c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ef7f0adb-9324-43ac-b3b7-593900b1576f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-a0e43e71-d9cb-4f7c-83e6-95f0ecacabca req-75d2c1f7-d59d-45d2-8bad-a5971f35cbb1 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received event network-vif-unplugged-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a0e43e71-d9cb-4f7c-83e6-95f0ecacabca req-75d2c1f7-d59d-45d2-8bad-a5971f35cbb1 service nova] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a0e43e71-d9cb-4f7c-83e6-95f0ecacabca req-75d2c1f7-d59d-45d2-8bad-a5971f35cbb1 service nova] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a0e43e71-d9cb-4f7c-83e6-95f0ecacabca req-75d2c1f7-d59d-45d2-8bad-a5971f35cbb1 service nova] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-a0e43e71-d9cb-4f7c-83e6-95f0ecacabca req-75d2c1f7-d59d-45d2-8bad-a5971f35cbb1 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] No waiting events found dispatching network-vif-unplugged-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-a0e43e71-d9cb-4f7c-83e6-95f0ecacabca req-75d2c1f7-d59d-45d2-8bad-a5971f35cbb1 service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received event network-vif-unplugged-5cab1496-d1b3-4d92-858e-d193a55c29cc for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.834s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 20:52:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Instance destroyed successfully.
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'resources' on Instance uuid 820f7ca5-8bf5-494d-8dae-b0ee3431f156 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] There are 0 instances to clean {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-588705009',display_name='tempest-AttachVolumeNegativeTest-server-588705009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-588705009',id=17,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+5+NqK3uyNpW36c/sHNBeDB7ty4MpoZfbTYyW9hggYFkw7mFXurk5iPO88TObGL18EskuijzXLbAKoEk82PZ2RkI77zFpq6F7f+s7H+irMXNRqqCuuycE/PgoDx/Squg==',key_name='tempest-keypair-1804821331',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-ln6ai8j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=820f7ca5-8bf5-494d-8dae-b0ee3431f156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "address": "fa:16:3e:4f:3d:52", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cab1496-d1", "ovs_interfaceid": "5cab1496-d1b3-4d92-858e-d193a55c29cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:3d:52,bridge_name='br-int',has_traffic_filtering=True,id=5cab1496-d1b3-4d92-858e-d193a55c29cc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab1496-d1') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG os_vif [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:3d:52,bridge_name='br-int',has_traffic_filtering=True,id=5cab1496-d1b3-4d92-858e-d193a55c29cc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab1496-d1') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cab1496-d1, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:47 user nova-compute[73476]: INFO os_vif [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:3d:52,bridge_name='br-int',has_traffic_filtering=True,id=5cab1496-d1b3-4d92-858e-d193a55c29cc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cab1496-d1')
Aug 26 20:52:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Deleting instance files /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156_del
Aug 26 20:52:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Deletion of /opt/stack/data/nova/instances/820f7ca5-8bf5-494d-8dae-b0ee3431f156_del complete
Aug 26 20:52:47 user nova-compute[73476]: INFO nova.compute.manager [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 20:52:47 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:52:47 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:52:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-06f89624-0c51-4a5c-9a18-9d91ad8495d4 req-b126d23f-277e-4d08-9072-f2f9960ebd3f service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received event network-vif-plugged-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-06f89624-0c51-4a5c-9a18-9d91ad8495d4 req-b126d23f-277e-4d08-9072-f2f9960ebd3f service nova] Acquiring lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-06f89624-0c51-4a5c-9a18-9d91ad8495d4 req-b126d23f-277e-4d08-9072-f2f9960ebd3f service nova] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-06f89624-0c51-4a5c-9a18-9d91ad8495d4 req-b126d23f-277e-4d08-9072-f2f9960ebd3f service nova] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-06f89624-0c51-4a5c-9a18-9d91ad8495d4 req-b126d23f-277e-4d08-9072-f2f9960ebd3f service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] No waiting events found dispatching network-vif-plugged-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:49 user nova-compute[73476]: WARNING nova.compute.manager [req-06f89624-0c51-4a5c-9a18-9d91ad8495d4 req-b126d23f-277e-4d08-9072-f2f9960ebd3f service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received unexpected event network-vif-plugged-5cab1496-d1b3-4d92-858e-d193a55c29cc for instance with vm_state active and task_state deleting.
Aug 26 20:52:49 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:49 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Took 2.12 seconds to deallocate network for instance.
Aug 26 20:52:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:50 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:52:50 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:52:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:50 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Deleted allocations for instance 820f7ca5-8bf5-494d-8dae-b0ee3431f156
Aug 26 20:52:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5034bb7d-11ac-4074-a4d0-6e7f0e9d060e tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "820f7ca5-8bf5-494d-8dae-b0ee3431f156" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.849s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:51 user nova-compute[73476]: DEBUG nova.compute.manager [req-a19b34b9-ca30-4d89-9ff5-d2bc4ad800e7 req-7f774560-c1cb-4c92-9497-7c50d41c320c service nova] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Received event network-vif-deleted-5cab1496-d1b3-4d92-858e-d193a55c29cc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:52:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:52:53 user nova-compute[73476]: INFO nova.compute.claims [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Claim successful on node user
Aug 26 20:52:53 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:52:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083159.0364103, ba24bae1-d608-41dd-b928-fad3ba415cc1 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:52:54 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] VM Stopped (Lifecycle Event)
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cbc4617e-86e5-4fc0-9ce3-d3983b3c60dc None None] [instance: ba24bae1-d608-41dd-b928-fad3ba415cc1] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG nova.network.neutron [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:52:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:52:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG nova.policy [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd38f2a23de67450a825596c77fe9dbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166fe05519d74dd78e3228e47ef09e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:52:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Creating image(s)
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "/opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "/opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "/opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk 1073741824" returned: 0 in 0.048s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.216s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Successfully created port: bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Cannot resize image /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Ensure instance console log exists: /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:52:55 user nova-compute[73476]: INFO nova.compute.claims [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Claim successful on node user
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Successfully updated port: bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-32218a61-6010-40f6-964d-47ebd9f1df96 req-a0a9d482-cd67-43b9-9205-f37c7a378d94 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-changed-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-32218a61-6010-40f6-964d-47ebd9f1df96 req-a0a9d482-cd67-43b9-9205-f37c7a378d94 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Refreshing instance network info cache due to event network-changed-bba57062-58f4-47ce-99cf-792a4fdb81c3. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-32218a61-6010-40f6-964d-47ebd9f1df96 req-a0a9d482-cd67-43b9-9205-f37c7a378d94 service nova] Acquiring lock "refresh_cache-08d4a50e-f447-43b0-9b57-9c73a9b11d3e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-32218a61-6010-40f6-964d-47ebd9f1df96 req-a0a9d482-cd67-43b9-9205-f37c7a378d94 service nova] Acquired lock "refresh_cache-08d4a50e-f447-43b0-9b57-9c73a9b11d3e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:52:55 user nova-compute[73476]: DEBUG nova.network.neutron [req-32218a61-6010-40f6-964d-47ebd9f1df96 req-a0a9d482-cd67-43b9-9205-f37c7a378d94 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Refreshing network info cache for port bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "refresh_cache-08d4a50e-f447-43b0-9b57-9c73a9b11d3e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.network.neutron [req-32218a61-6010-40f6-964d-47ebd9f1df96 req-a0a9d482-cd67-43b9-9205-f37c7a378d94 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.network.neutron [req-32218a61-6010-40f6-964d-47ebd9f1df96 req-a0a9d482-cd67-43b9-9205-f37c7a378d94 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-32218a61-6010-40f6-964d-47ebd9f1df96 req-a0a9d482-cd67-43b9-9205-f37c7a378d94 service nova] Releasing lock "refresh_cache-08d4a50e-f447-43b0-9b57-9c73a9b11d3e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquired lock "refresh_cache-08d4a50e-f447-43b0-9b57-9c73a9b11d3e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:52:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:52:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Creating image(s)
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.policy [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd92c80cbcec44e1db0b0838e2574222a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8203758c21c944a3b6412f96d7e55246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Updating instance_info_cache with network_info: [{"id": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "address": "fa:16:3e:67:af:7b", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba57062-58", "ovs_interfaceid": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Releasing lock "refresh_cache-08d4a50e-f447-43b0-9b57-9c73a9b11d3e" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Instance network_info: |[{"id": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "address": "fa:16:3e:67:af:7b", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba57062-58", "ovs_interfaceid": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Start _get_guest_xml network_info=[{"id": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "address": "fa:16:3e:67:af:7b", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba57062-58", "ovs_interfaceid": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:52:56 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:56 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1671664455',display_name='tempest-VolumesActionsTest-instance-1671664455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1671664455',id=27,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='166fe05519d74dd78e3228e47ef09e90',ramdisk_id='',reservation_id='r-vvh4rgqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-562295190',owner_user_name='tempest-VolumesActionsTest-562295190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:52:54Z,user_data=None,user_id='d38f2a23de67450a825596c77fe9dbf2',uuid=08d4a50e-f447-43b0-9b57-9c73a9b11d3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "address": "fa:16:3e:67:af:7b", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba57062-58", "ovs_interfaceid": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converting VIF {"id": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "address": "fa:16:3e:67:af:7b", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba57062-58", "ovs_interfaceid": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:52:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:af:7b,bridge_name='br-int',has_traffic_filtering=True,id=bba57062-58f4-47ce-99cf-792a4fdb81c3,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba57062-58') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lazy-loading 'pci_devices' on Instance uuid 08d4a50e-f447-43b0-9b57-9c73a9b11d3e {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:52:57 user nova-compute[73476]:   <uuid>08d4a50e-f447-43b0-9b57-9c73a9b11d3e</uuid>
Aug 26 20:52:57 user nova-compute[73476]:   <name>instance-0000001b</name>
Aug 26 20:52:57 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:52:57 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:52:57 user nova-compute[73476]:   <metadata>
Aug 26 20:52:57 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:52:57 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:52:57 user nova-compute[73476]:       <nova:name>tempest-VolumesActionsTest-instance-1671664455</nova:name>
Aug 26 20:52:57 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:52:56</nova:creationTime>
Aug 26 20:52:57 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:52:57 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:52:57 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:52:57 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:52:57 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:52:57 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:52:57 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:52:57 user nova-compute[73476]:       <nova:owner>
Aug 26 20:52:57 user nova-compute[73476]:         <nova:user uuid="d38f2a23de67450a825596c77fe9dbf2">tempest-VolumesActionsTest-562295190-project-member</nova:user>
Aug 26 20:52:57 user nova-compute[73476]:         <nova:project uuid="166fe05519d74dd78e3228e47ef09e90">tempest-VolumesActionsTest-562295190</nova:project>
Aug 26 20:52:57 user nova-compute[73476]:       </nova:owner>
Aug 26 20:52:57 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:52:57 user nova-compute[73476]:       <nova:ports>
Aug 26 20:52:57 user nova-compute[73476]:         <nova:port uuid="bba57062-58f4-47ce-99cf-792a4fdb81c3">
Aug 26 20:52:57 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 20:52:57 user nova-compute[73476]:         </nova:port>
Aug 26 20:52:57 user nova-compute[73476]:       </nova:ports>
Aug 26 20:52:57 user nova-compute[73476]:     </nova:instance>
Aug 26 20:52:57 user nova-compute[73476]:   </metadata>
Aug 26 20:52:57 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:52:57 user nova-compute[73476]:     <system>
Aug 26 20:52:57 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:52:57 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:52:57 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:52:57 user nova-compute[73476]:       <entry name="serial">08d4a50e-f447-43b0-9b57-9c73a9b11d3e</entry>
Aug 26 20:52:57 user nova-compute[73476]:       <entry name="uuid">08d4a50e-f447-43b0-9b57-9c73a9b11d3e</entry>
Aug 26 20:52:57 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:52:57 user nova-compute[73476]:     </system>
Aug 26 20:52:57 user nova-compute[73476]:   </sysinfo>
Aug 26 20:52:57 user nova-compute[73476]:   <os>
Aug 26 20:52:57 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:52:57 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:52:57 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:52:57 user nova-compute[73476]:   </os>
Aug 26 20:52:57 user nova-compute[73476]:   <features>
Aug 26 20:52:57 user nova-compute[73476]:     <acpi/>
Aug 26 20:52:57 user nova-compute[73476]:     <apic/>
Aug 26 20:52:57 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:52:57 user nova-compute[73476]:   </features>
Aug 26 20:52:57 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:52:57 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:52:57 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:52:57 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:52:57 user nova-compute[73476]:   </clock>
Aug 26 20:52:57 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:52:57 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:52:57 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:52:57 user nova-compute[73476]:   </cpu>
Aug 26 20:52:57 user nova-compute[73476]:   <devices>
Aug 26 20:52:57 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:52:57 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:52:57 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk"/>
Aug 26 20:52:57 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:52:57 user nova-compute[73476]:     </disk>
Aug 26 20:52:57 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:52:57 user nova-compute[73476]:       <mac address="fa:16:3e:67:af:7b"/>
Aug 26 20:52:57 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:52:57 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:52:57 user nova-compute[73476]:       <target dev="tapbba57062-58"/>
Aug 26 20:52:57 user nova-compute[73476]:     </interface>
Aug 26 20:52:57 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:52:57 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/console.log" append="off"/>
Aug 26 20:52:57 user nova-compute[73476]:     </serial>
Aug 26 20:52:57 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:52:57 user nova-compute[73476]:     <video>
Aug 26 20:52:57 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:52:57 user nova-compute[73476]:     </video>
Aug 26 20:52:57 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:52:57 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:52:57 user nova-compute[73476]:     </rng>
Aug 26 20:52:57 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:52:57 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:52:57 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:52:57 user nova-compute[73476]:     </memballoon>
Aug 26 20:52:57 user nova-compute[73476]:   </devices>
Aug 26 20:52:57 user nova-compute[73476]: </domain>
Aug 26 20:52:57 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1671664455',display_name='tempest-VolumesActionsTest-instance-1671664455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1671664455',id=27,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='166fe05519d74dd78e3228e47ef09e90',ramdisk_id='',reservation_id='r-vvh4rgqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-562295190',owner_user_name='tempest-VolumesActionsTest-562295190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:52:54Z,user_data=None,user_id='d38f2a23de67450a825596c77fe9dbf2',uuid=08d4a50e-f447-43b0-9b57-9c73a9b11d3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "address": "fa:16:3e:67:af:7b", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba57062-58", "ovs_interfaceid": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converting VIF {"id": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "address": "fa:16:3e:67:af:7b", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba57062-58", "ovs_interfaceid": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:af:7b,bridge_name='br-int',has_traffic_filtering=True,id=bba57062-58f4-47ce-99cf-792a4fdb81c3,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba57062-58') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG os_vif [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:af:7b,bridge_name='br-int',has_traffic_filtering=True,id=bba57062-58f4-47ce-99cf-792a4fdb81c3,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba57062-58') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbba57062-58, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbba57062-58, col_values=(('external_ids', {'iface-id': 'bba57062-58f4-47ce-99cf-792a4fdb81c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:af:7b', 'vm-uuid': '08d4a50e-f447-43b0-9b57-9c73a9b11d3e'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:52:57 user nova-compute[73476]: INFO os_vif [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:af:7b,bridge_name='br-int',has_traffic_filtering=True,id=bba57062-58f4-47ce-99cf-792a4fdb81c3,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba57062-58')
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk 1073741824" returned: 0 in 0.051s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] No VIF found with MAC fa:16:3e:67:af:7b, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Cannot resize image /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Ensure instance console log exists: /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Successfully created port: 4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Successfully updated port: 4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquired lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-25a39610-b7e5-45db-9788-798463b2b122 req-5e15952b-25c8-4967-87c4-c758c7bd8b9e service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-changed-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-25a39610-b7e5-45db-9788-798463b2b122 req-5e15952b-25c8-4967-87c4-c758c7bd8b9e service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Refreshing instance network info cache due to event network-changed-4fbe332d-e987-48c7-9ddf-94e0e0427864. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-25a39610-b7e5-45db-9788-798463b2b122 req-5e15952b-25c8-4967-87c4-c758c7bd8b9e service nova] Acquiring lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-e53b67e5-7421-4aa1-91e8-31350c3990bc req-cc15aac5-abf4-43c7-b6c8-291f409847ff service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e53b67e5-7421-4aa1-91e8-31350c3990bc req-cc15aac5-abf4-43c7-b6c8-291f409847ff service nova] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e53b67e5-7421-4aa1-91e8-31350c3990bc req-cc15aac5-abf4-43c7-b6c8-291f409847ff service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e53b67e5-7421-4aa1-91e8-31350c3990bc req-cc15aac5-abf4-43c7-b6c8-291f409847ff service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:52:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-e53b67e5-7421-4aa1-91e8-31350c3990bc req-cc15aac5-abf4-43c7-b6c8-291f409847ff service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] No waiting events found dispatching network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:52:58 user nova-compute[73476]: WARNING nova.compute.manager [req-e53b67e5-7421-4aa1-91e8-31350c3990bc req-cc15aac5-abf4-43c7-b6c8-291f409847ff service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received unexpected event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 for instance with vm_state building and task_state spawning.
Aug 26 20:52:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Releasing lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Instance network_info: |[{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-25a39610-b7e5-45db-9788-798463b2b122 req-5e15952b-25c8-4967-87c4-c758c7bd8b9e service nova] Acquired lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.network.neutron [req-25a39610-b7e5-45db-9788-798463b2b122 req-5e15952b-25c8-4967-87c4-c758c7bd8b9e service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Refreshing network info cache for port 4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Start _get_guest_xml network_info=[{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:52:59 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:59 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1499031467',display_name='tempest-ServerStableDeviceRescueTest-server-1499031467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1499031467',id=28,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDawYycI76NkUKDRLbP9/BjRPLtgnBqjfQHAVSnC1A7iy3vv3tmWNE5+ydF0i5dZv7RrDZE5nZ7ua+6pZvputBnQRMIV1Od9pG1QQu6/dSZ8ykQv+vGnHBn6EvuJACGwCA==',key_name='tempest-keypair-1844255857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8203758c21c944a3b6412f96d7e55246',ramdisk_id='',reservation_id='r-4bx0u0o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1046559965',owner_user_name='tempest-ServerStableDeviceRescueTest-1046559965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d92c80cbcec44e1db0b0838e2574222a',uuid=8e964b8e-c28a-4f58-ad0e-d34212a36e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Converting VIF {"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f8:66,bridge_name='br-int',has_traffic_filtering=True,id=4fbe332d-e987-48c7-9ddf-94e0e0427864,network=Network(fb47d1e5-3099-46c3-8c85-029b18700b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbe332d-e9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:52:59 user nova-compute[73476]:   <uuid>8e964b8e-c28a-4f58-ad0e-d34212a36e42</uuid>
Aug 26 20:52:59 user nova-compute[73476]:   <name>instance-0000001c</name>
Aug 26 20:52:59 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:52:59 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:52:59 user nova-compute[73476]:   <metadata>
Aug 26 20:52:59 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:52:59 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:52:59 user nova-compute[73476]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1499031467</nova:name>
Aug 26 20:52:59 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:52:59</nova:creationTime>
Aug 26 20:52:59 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:52:59 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:52:59 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:52:59 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:52:59 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:52:59 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:52:59 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:52:59 user nova-compute[73476]:       <nova:owner>
Aug 26 20:52:59 user nova-compute[73476]:         <nova:user uuid="d92c80cbcec44e1db0b0838e2574222a">tempest-ServerStableDeviceRescueTest-1046559965-project-member</nova:user>
Aug 26 20:52:59 user nova-compute[73476]:         <nova:project uuid="8203758c21c944a3b6412f96d7e55246">tempest-ServerStableDeviceRescueTest-1046559965</nova:project>
Aug 26 20:52:59 user nova-compute[73476]:       </nova:owner>
Aug 26 20:52:59 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:52:59 user nova-compute[73476]:       <nova:ports>
Aug 26 20:52:59 user nova-compute[73476]:         <nova:port uuid="4fbe332d-e987-48c7-9ddf-94e0e0427864">
Aug 26 20:52:59 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 20:52:59 user nova-compute[73476]:         </nova:port>
Aug 26 20:52:59 user nova-compute[73476]:       </nova:ports>
Aug 26 20:52:59 user nova-compute[73476]:     </nova:instance>
Aug 26 20:52:59 user nova-compute[73476]:   </metadata>
Aug 26 20:52:59 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:52:59 user nova-compute[73476]:     <system>
Aug 26 20:52:59 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:52:59 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:52:59 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:52:59 user nova-compute[73476]:       <entry name="serial">8e964b8e-c28a-4f58-ad0e-d34212a36e42</entry>
Aug 26 20:52:59 user nova-compute[73476]:       <entry name="uuid">8e964b8e-c28a-4f58-ad0e-d34212a36e42</entry>
Aug 26 20:52:59 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:52:59 user nova-compute[73476]:     </system>
Aug 26 20:52:59 user nova-compute[73476]:   </sysinfo>
Aug 26 20:52:59 user nova-compute[73476]:   <os>
Aug 26 20:52:59 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:52:59 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:52:59 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:52:59 user nova-compute[73476]:   </os>
Aug 26 20:52:59 user nova-compute[73476]:   <features>
Aug 26 20:52:59 user nova-compute[73476]:     <acpi/>
Aug 26 20:52:59 user nova-compute[73476]:     <apic/>
Aug 26 20:52:59 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:52:59 user nova-compute[73476]:   </features>
Aug 26 20:52:59 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:52:59 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:52:59 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:52:59 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:52:59 user nova-compute[73476]:   </clock>
Aug 26 20:52:59 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:52:59 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:52:59 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:52:59 user nova-compute[73476]:   </cpu>
Aug 26 20:52:59 user nova-compute[73476]:   <devices>
Aug 26 20:52:59 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:52:59 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:52:59 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk"/>
Aug 26 20:52:59 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:52:59 user nova-compute[73476]:     </disk>
Aug 26 20:52:59 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:52:59 user nova-compute[73476]:       <mac address="fa:16:3e:04:f8:66"/>
Aug 26 20:52:59 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:52:59 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:52:59 user nova-compute[73476]:       <target dev="tap4fbe332d-e9"/>
Aug 26 20:52:59 user nova-compute[73476]:     </interface>
Aug 26 20:52:59 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:52:59 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/console.log" append="off"/>
Aug 26 20:52:59 user nova-compute[73476]:     </serial>
Aug 26 20:52:59 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:52:59 user nova-compute[73476]:     <video>
Aug 26 20:52:59 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:52:59 user nova-compute[73476]:     </video>
Aug 26 20:52:59 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:52:59 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:52:59 user nova-compute[73476]:     </rng>
Aug 26 20:52:59 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:52:59 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:52:59 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:52:59 user nova-compute[73476]:     </memballoon>
Aug 26 20:52:59 user nova-compute[73476]:   </devices>
Aug 26 20:52:59 user nova-compute[73476]: </domain>
Aug 26 20:52:59 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1499031467',display_name='tempest-ServerStableDeviceRescueTest-server-1499031467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1499031467',id=28,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDawYycI76NkUKDRLbP9/BjRPLtgnBqjfQHAVSnC1A7iy3vv3tmWNE5+ydF0i5dZv7RrDZE5nZ7ua+6pZvputBnQRMIV1Od9pG1QQu6/dSZ8ykQv+vGnHBn6EvuJACGwCA==',key_name='tempest-keypair-1844255857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8203758c21c944a3b6412f96d7e55246',ramdisk_id='',reservation_id='r-4bx0u0o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1046559965',owner_user_name='tempest-ServerStableDeviceRescueTest-1046559965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d92c80cbcec44e1db0b0838e2574222a',uuid=8e964b8e-c28a-4f58-ad0e-d34212a36e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Converting VIF {"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f8:66,bridge_name='br-int',has_traffic_filtering=True,id=4fbe332d-e987-48c7-9ddf-94e0e0427864,network=Network(fb47d1e5-3099-46c3-8c85-029b18700b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbe332d-e9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG os_vif [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f8:66,bridge_name='br-int',has_traffic_filtering=True,id=4fbe332d-e987-48c7-9ddf-94e0e0427864,network=Network(fb47d1e5-3099-46c3-8c85-029b18700b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbe332d-e9') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fbe332d-e9, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fbe332d-e9, col_values=(('external_ids', {'iface-id': '4fbe332d-e987-48c7-9ddf-94e0e0427864', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f8:66', 'vm-uuid': '8e964b8e-c28a-4f58-ad0e-d34212a36e42'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:59 user nova-compute[73476]: INFO os_vif [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f8:66,bridge_name='br-int',has_traffic_filtering=True,id=4fbe332d-e987-48c7-9ddf-94e0e0427864,network=Network(fb47d1e5-3099-46c3-8c85-029b18700b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbe332d-e9')
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] No VIF found with MAC fa:16:3e:04:f8:66, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.network.neutron [req-25a39610-b7e5-45db-9788-798463b2b122 req-5e15952b-25c8-4967-87c4-c758c7bd8b9e service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updated VIF entry in instance network info cache for port 4fbe332d-e987-48c7-9ddf-94e0e0427864. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.network.neutron [req-25a39610-b7e5-45db-9788-798463b2b122 req-5e15952b-25c8-4967-87c4-c758c7bd8b9e service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-25a39610-b7e5-45db-9788-798463b2b122 req-5e15952b-25c8-4967-87c4-c758c7bd8b9e service nova] Releasing lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:52:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:53:00 user nova-compute[73476]: INFO nova.compute.claims [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Claim successful on node user
Aug 26 20:53:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:53:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:53:00 user nova-compute[73476]: DEBUG nova.policy [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ed2a98f37294fd381fd1dfe7c5c0751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679727d63ba04ad48740d1b967be5a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:53:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:53:00 user nova-compute[73476]: INFO nova.virt.block_device [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Booting with volume-backed-image 810a80fc-a1eb-411e-8c1f-b24c6f7ca436 at /dev/vda
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-a79b29f5-afab-41c8-906d-869fc77dc671 req-2956bafc-8dbc-4aa7-b405-eef8d801c320 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a79b29f5-afab-41c8-906d-869fc77dc671 req-2956bafc-8dbc-4aa7-b405-eef8d801c320 service nova] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a79b29f5-afab-41c8-906d-869fc77dc671 req-2956bafc-8dbc-4aa7-b405-eef8d801c320 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a79b29f5-afab-41c8-906d-869fc77dc671 req-2956bafc-8dbc-4aa7-b405-eef8d801c320 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-a79b29f5-afab-41c8-906d-869fc77dc671 req-2956bafc-8dbc-4aa7-b405-eef8d801c320 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] No waiting events found dispatching network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:01 user nova-compute[73476]: WARNING nova.compute.manager [req-a79b29f5-afab-41c8-906d-869fc77dc671 req-2956bafc-8dbc-4aa7-b405-eef8d801c320 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received unexpected event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 for instance with vm_state building and task_state spawning.
Aug 26 20:53:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083181.0587153, 08d4a50e-f447-43b0-9b57-9c73a9b11d3e => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] VM Resumed (Lifecycle Event)
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:01 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Instance spawned successfully.
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083181.0597305, 08d4a50e-f447-43b0-9b57-9c73a9b11d3e => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] VM Started (Lifecycle Event)
Aug 26 20:53:01 user nova-compute[73476]: INFO nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:01 user nova-compute[73476]: INFO nova.compute.manager [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Took 8.00 seconds to build instance.
Aug 26 20:53:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63c06d19-bebf-4291-ac86-e2703f9d3dec tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.104s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Successfully created port: 9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:02 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083167.658638, 820f7ca5-8bf5-494d-8dae-b0ee3431f156 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:02 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] VM Stopped (Lifecycle Event)
Aug 26 20:53:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f761e9f3-3b29-4a5b-aefd-77812f8dfb74 None None] [instance: 820f7ca5-8bf5-494d-8dae-b0ee3431f156] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Successfully updated port: 9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:53:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquired lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:53:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-1241f09f-d170-4637-8f34-3de764fe9a4b req-691a2462-2936-441f-8ea4-542ec92db760 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-changed-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-1241f09f-d170-4637-8f34-3de764fe9a4b req-691a2462-2936-441f-8ea4-542ec92db760 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Refreshing instance network info cache due to event network-changed-9b7fc934-fd11-4397-92d8-3aa023d9e63b. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:53:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1241f09f-d170-4637-8f34-3de764fe9a4b req-691a2462-2936-441f-8ea4-542ec92db760 service nova] Acquiring lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:03 user nova-compute[73476]: WARNING nova.compute.manager [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state building and task_state spawning.
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:03 user nova-compute[73476]: WARNING nova.compute.manager [req-03cced02-3321-4dbb-9edd-b6936cb3e029 req-b061e534-aa23-413f-94b0-45486dc5c1ad service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state building and task_state spawning.
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.network.neutron [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Updating instance_info_cache with network_info: [{"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Releasing lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Instance network_info: |[{"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1241f09f-d170-4637-8f34-3de764fe9a4b req-691a2462-2936-441f-8ea4-542ec92db760 service nova] Acquired lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-1241f09f-d170-4637-8f34-3de764fe9a4b req-691a2462-2936-441f-8ea4-542ec92db760 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Refreshing network info cache for port 9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083183.4320931, 8e964b8e-c28a-4f58-ad0e-d34212a36e42 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:03 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] VM Resumed (Lifecycle Event)
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:53:03 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Instance spawned successfully.
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:03 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083183.436044, 8e964b8e-c28a-4f58-ad0e-d34212a36e42 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:03 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] VM Started (Lifecycle Event)
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:03 user nova-compute[73476]: INFO nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Took 6.93 seconds to spawn the instance on the hypervisor.
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:03 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:03 user nova-compute[73476]: INFO nova.compute.manager [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Took 7.92 seconds to build instance.
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f26f2166-5882-41c3-8f56-3c39cfd7f66e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.033s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-1241f09f-d170-4637-8f34-3de764fe9a4b req-691a2462-2936-441f-8ea4-542ec92db760 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Updated VIF entry in instance network info cache for port 9b7fc934-fd11-4397-92d8-3aa023d9e63b. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-1241f09f-d170-4637-8f34-3de764fe9a4b req-691a2462-2936-441f-8ea4-542ec92db760 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Updating instance_info_cache with network_info: [{"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1241f09f-d170-4637-8f34-3de764fe9a4b req-691a2462-2936-441f-8ea4-542ec92db760 service nova] Releasing lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG os_brick.utils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a3fd9d-0f5f-4ce0-8989-94583d08872a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[47559454-ff91-4d88-b403-226d10cfcae7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e56e4-e31f-41b4-8c23-4895a8f11fd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7758f0e-b7cf-4bdd-a7b7-04d66a2878f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:53:16 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:53:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b7742d-12be-4be7-b1ad-6942cff86ced]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG os_brick.utils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:53:16 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Updating existing volume attachment record: 70f3243b-d50b-4b98-b0e3-0fc359feab5c {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:53:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "aae763e2-8571-4c3f-91e3-4cc501b3d335" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:53:21 user nova-compute[73476]: INFO nova.compute.claims [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Claim successful on node user
Aug 26 20:53:21 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:53:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:53:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG nova.policy [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdf18fb0dcd64e11a7e42cc5184a219e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b16d8f644f0442fea1f8a57961111a30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:53:21 user nova-compute[73476]: INFO nova.virt.block_device [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Booting with volume f5759c38-31d0-4814-b985-f3cdb3f80011 at /dev/vda
Aug 26 20:53:21 user nova-compute[73476]: DEBUG os_brick.utils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5cf6e9-9e88-48da-90a3-bdaa372528d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[34187caf-ff62-450c-87e6-1f03b97c60fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[194531d2-d3bb-4480-a29e-3ed7b058e551]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c62c24-1e3e-4964-8542-94d7341d5d05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:53:22 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:53:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3f1823-9f7f-4140-b2d7-ca1798c35fb7]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG os_brick.utils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updating existing volume attachment record: b61d611f-e20d-4c27-9391-37f67bae8435 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:53:22 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Successfully created port: a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Successfully updated port: a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquired lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-b4b4bdd3-4889-44d9-befd-54a167e70343 req-692948c7-f552-4c56-9525-f8714eda4d7a service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received event network-changed-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-b4b4bdd3-4889-44d9-befd-54a167e70343 req-692948c7-f552-4c56-9525-f8714eda4d7a service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Refreshing instance network info cache due to event network-changed-a830ab77-92de-4d26-9371-0c133f6d2bf1. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b4b4bdd3-4889-44d9-befd-54a167e70343 req-692948c7-f552-4c56-9525-f8714eda4d7a service nova] Acquiring lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updating instance_info_cache with network_info: [{"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Releasing lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Instance network_info: |[{"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b4b4bdd3-4889-44d9-befd-54a167e70343 req-692948c7-f552-4c56-9525-f8714eda4d7a service nova] Acquired lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:23 user nova-compute[73476]: DEBUG nova.network.neutron [req-b4b4bdd3-4889-44d9-befd-54a167e70343 req-692948c7-f552-4c56-9525-f8714eda4d7a service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Refreshing network info cache for port a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:53:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-5d00df06-191d-4448-8b44-79d9b61609e7 req-f0a5257a-7be9-413d-8c57-5efd4ababb08 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received event network-changed-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-5d00df06-191d-4448-8b44-79d9b61609e7 req-f0a5257a-7be9-413d-8c57-5efd4ababb08 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Refreshing instance network info cache due to event network-changed-e016713d-e390-4c42-b097-4907edc7ba6e. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:53:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5d00df06-191d-4448-8b44-79d9b61609e7 req-f0a5257a-7be9-413d-8c57-5efd4ababb08 service nova] Acquiring lock "refresh_cache-ef7f0adb-9324-43ac-b3b7-593900b1576f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5d00df06-191d-4448-8b44-79d9b61609e7 req-f0a5257a-7be9-413d-8c57-5efd4ababb08 service nova] Acquired lock "refresh_cache-ef7f0adb-9324-43ac-b3b7-593900b1576f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:24 user nova-compute[73476]: DEBUG nova.network.neutron [req-5d00df06-191d-4448-8b44-79d9b61609e7 req-f0a5257a-7be9-413d-8c57-5efd4ababb08 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Refreshing network info cache for port e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:53:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:24 user nova-compute[73476]: DEBUG nova.network.neutron [req-b4b4bdd3-4889-44d9-befd-54a167e70343 req-692948c7-f552-4c56-9525-f8714eda4d7a service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updated VIF entry in instance network info cache for port a830ab77-92de-4d26-9371-0c133f6d2bf1. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:53:24 user nova-compute[73476]: DEBUG nova.network.neutron [req-b4b4bdd3-4889-44d9-befd-54a167e70343 req-692948c7-f552-4c56-9525-f8714eda4d7a service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updating instance_info_cache with network_info: [{"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b4b4bdd3-4889-44d9-befd-54a167e70343 req-692948c7-f552-4c56-9525-f8714eda4d7a service nova] Releasing lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:25 user nova-compute[73476]: DEBUG nova.network.neutron [req-5d00df06-191d-4448-8b44-79d9b61609e7 req-f0a5257a-7be9-413d-8c57-5efd4ababb08 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Updated VIF entry in instance network info cache for port e016713d-e390-4c42-b097-4907edc7ba6e. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:53:25 user nova-compute[73476]: DEBUG nova.network.neutron [req-5d00df06-191d-4448-8b44-79d9b61609e7 req-f0a5257a-7be9-413d-8c57-5efd4ababb08 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Updating instance_info_cache with network_info: [{"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5d00df06-191d-4448-8b44-79d9b61609e7 req-f0a5257a-7be9-413d-8c57-5efd4ababb08 service nova] Releasing lock "refresh_cache-ef7f0adb-9324-43ac-b3b7-593900b1576f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:53:28 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Creating image(s)
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Ensure instance console log exists: /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Start _get_guest_xml network_info=[{"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '70f3243b-d50b-4b98-b0e3-0fc359feab5c', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFrSDmag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8644e702-6fc8-4c84-a208-ef9a78cda0ee', 'attached_at': '', 'detached_at': '', 'volume_id': '769f3a13-ce9a-4343-aa19-4fd3d34a90fb', 'serial': '769f3a13-ce9a-4343-aa19-4fd3d34a90fb'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:53:28 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:28 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFrSDmag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:53:28 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:53:28 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:53:28 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a72f073-7ab3-4c3d-a3ec-58e676d6b384]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:53:28 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aa2984-6e06-463a-b5ea-2a3fee964481]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb] added
Aug 26 20:53:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f051d369-5579-46d2-83a6-61bcbf448636]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece28a21-3f9d-4cf9-b3ef-bd99cb7901c1]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFrSDmag {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFrSDmag" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c76e57-7937-42b8-b7d6-856dce0ddc81]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BFrSDmag'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b9d0cc-082b-4d2d-b76f-1d30db5729fe]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9638b56c-c2b9-4d86-9337-2cff2ab9183a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:28 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:28 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:53:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bed95d-50f4-41a4-9add-ed458ff831a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb, portal: 172.16.0.220,3260]
Aug 26 20:53:29 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb, portal: 172.16.0.220,3260] successful.
Aug 26 20:53:29 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf6c252-c848-4629-a4d0-48690a27369b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fafa70-a0d2-439a-a0cb-2509f3510305]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:29 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:29 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:29 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:29 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:29 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:29 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3747d0b-4354-4b82-95b5-8988f98e81be]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG nova.objects.instance [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lazy-loading 'flavor' on Instance uuid ef7f0adb-9324-43ac-b3b7-593900b1576f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:29 user nova-compute[73476]: INFO nova.compute.manager [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Attaching volume 53f8ac9c-1764-4679-8161-df889b6b83c0 to /dev/vdb
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.utils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d4081-ef2d-46e9-a72d-80797ea3ae50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92a5e75-b16c-4b75-bf64-71e9493a5f7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1596e32e-0a58-4e73-bb7c-c24722512f0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf0ea8b-fc54-4751-8afe-57dde2f1f16e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:53:30 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:53:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[471a379e-0f2e-48eb-9f86-2a61481d20ed]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.utils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Updating existing volume attachment record: f92aa5e7-0863-4239-b80a-3d04cdc9951c {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFrSDmag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23035666633333231', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035666633333231', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-329720098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-329720098',id=29,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-bjxqghlw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:53:01Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=8644e702-6fc8-4c84-a208-ef9a78cda0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=9b7fc934-fd11-4397-92d8-3aa023d9e63b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7fc934-fd') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.objects.instance [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'pci_devices' on Instance uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:53:30 user nova-compute[73476]:   <uuid>8644e702-6fc8-4c84-a208-ef9a78cda0ee</uuid>
Aug 26 20:53:30 user nova-compute[73476]:   <name>instance-0000001d</name>
Aug 26 20:53:30 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:53:30 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:53:30 user nova-compute[73476]:   <metadata>
Aug 26 20:53:30 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:53:30 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:53:30 user nova-compute[73476]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-329720098</nova:name>
Aug 26 20:53:30 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:53:28</nova:creationTime>
Aug 26 20:53:30 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:53:30 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:53:30 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:53:30 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:53:30 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:53:30 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:53:30 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:53:30 user nova-compute[73476]:       <nova:owner>
Aug 26 20:53:30 user nova-compute[73476]:         <nova:user uuid="5ed2a98f37294fd381fd1dfe7c5c0751">tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member</nova:user>
Aug 26 20:53:30 user nova-compute[73476]:         <nova:project uuid="679727d63ba04ad48740d1b967be5a61">tempest-ServerBootFromVolumeStableRescueTest-735166680</nova:project>
Aug 26 20:53:30 user nova-compute[73476]:       </nova:owner>
Aug 26 20:53:30 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:53:30 user nova-compute[73476]:       <nova:ports>
Aug 26 20:53:30 user nova-compute[73476]:         <nova:port uuid="9b7fc934-fd11-4397-92d8-3aa023d9e63b">
Aug 26 20:53:30 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 20:53:30 user nova-compute[73476]:         </nova:port>
Aug 26 20:53:30 user nova-compute[73476]:       </nova:ports>
Aug 26 20:53:30 user nova-compute[73476]:     </nova:instance>
Aug 26 20:53:30 user nova-compute[73476]:   </metadata>
Aug 26 20:53:30 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:53:30 user nova-compute[73476]:     <system>
Aug 26 20:53:30 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:53:30 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:53:30 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:53:30 user nova-compute[73476]:       <entry name="serial">8644e702-6fc8-4c84-a208-ef9a78cda0ee</entry>
Aug 26 20:53:30 user nova-compute[73476]:       <entry name="uuid">8644e702-6fc8-4c84-a208-ef9a78cda0ee</entry>
Aug 26 20:53:30 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:53:30 user nova-compute[73476]:     </system>
Aug 26 20:53:30 user nova-compute[73476]:   </sysinfo>
Aug 26 20:53:30 user nova-compute[73476]:   <os>
Aug 26 20:53:30 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:53:30 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:53:30 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:53:30 user nova-compute[73476]:   </os>
Aug 26 20:53:30 user nova-compute[73476]:   <features>
Aug 26 20:53:30 user nova-compute[73476]:     <acpi/>
Aug 26 20:53:30 user nova-compute[73476]:     <apic/>
Aug 26 20:53:30 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:53:30 user nova-compute[73476]:   </features>
Aug 26 20:53:30 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:53:30 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:53:30 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:53:30 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:53:30 user nova-compute[73476]:   </clock>
Aug 26 20:53:30 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:53:30 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:53:30 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:53:30 user nova-compute[73476]:   </cpu>
Aug 26 20:53:30 user nova-compute[73476]:   <devices>
Aug 26 20:53:30 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:53:30 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:53:30 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 20:53:30 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:53:30 user nova-compute[73476]:       <serial>769f3a13-ce9a-4343-aa19-4fd3d34a90fb</serial>
Aug 26 20:53:30 user nova-compute[73476]:     </disk>
Aug 26 20:53:30 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:53:30 user nova-compute[73476]:       <mac address="fa:16:3e:43:d5:a5"/>
Aug 26 20:53:30 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:30 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:53:30 user nova-compute[73476]:       <target dev="tap9b7fc934-fd"/>
Aug 26 20:53:30 user nova-compute[73476]:     </interface>
Aug 26 20:53:30 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:53:30 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/console.log" append="off"/>
Aug 26 20:53:30 user nova-compute[73476]:     </serial>
Aug 26 20:53:30 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:53:30 user nova-compute[73476]:     <video>
Aug 26 20:53:30 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:30 user nova-compute[73476]:     </video>
Aug 26 20:53:30 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:53:30 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:53:30 user nova-compute[73476]:     </rng>
Aug 26 20:53:30 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:53:30 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:53:30 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:53:30 user nova-compute[73476]:     </memballoon>
Aug 26 20:53:30 user nova-compute[73476]:   </devices>
Aug 26 20:53:30 user nova-compute[73476]: </domain>
Aug 26 20:53:30 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-329720098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-329720098',id=29,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-bjxqghlw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:53:01Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=8644e702-6fc8-4c84-a208-ef9a78cda0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=9b7fc934-fd11-4397-92d8-3aa023d9e63b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7fc934-fd') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG os_vif [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=9b7fc934-fd11-4397-92d8-3aa023d9e63b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7fc934-fd') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b7fc934-fd, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b7fc934-fd, col_values=(('external_ids', {'iface-id': '9b7fc934-fd11-4397-92d8-3aa023d9e63b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:d5:a5', 'vm-uuid': '8644e702-6fc8-4c84-a208-ef9a78cda0ee'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:30 user nova-compute[73476]: INFO os_vif [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=9b7fc934-fd11-4397-92d8-3aa023d9e63b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7fc934-fd')
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:53:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No VIF found with MAC fa:16:3e:43:d5:a5, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:53:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:31 user nova-compute[73476]: DEBUG nova.compute.manager [req-2227951c-9da4-4e27-8239-d86e6f82fec4 req-4c287297-9556-4295-a3d3-a29a41925073 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2227951c-9da4-4e27-8239-d86e6f82fec4 req-4c287297-9556-4295-a3d3-a29a41925073 service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2227951c-9da4-4e27-8239-d86e6f82fec4 req-4c287297-9556-4295-a3d3-a29a41925073 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2227951c-9da4-4e27-8239-d86e6f82fec4 req-4c287297-9556-4295-a3d3-a29a41925073 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:31 user nova-compute[73476]: DEBUG nova.compute.manager [req-2227951c-9da4-4e27-8239-d86e6f82fec4 req-4c287297-9556-4295-a3d3-a29a41925073 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:31 user nova-compute[73476]: WARNING nova.compute.manager [req-2227951c-9da4-4e27-8239-d86e6f82fec4 req-4c287297-9556-4295-a3d3-a29a41925073 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state building and task_state spawning.
Aug 26 20:53:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.compute.manager [req-4bf2cc03-1e53-4dba-b9ee-f9974c74d419 req-b801718f-653e-4701-86f5-a2381ac9b820 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4bf2cc03-1e53-4dba-b9ee-f9974c74d419 req-b801718f-653e-4701-86f5-a2381ac9b820 service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4bf2cc03-1e53-4dba-b9ee-f9974c74d419 req-b801718f-653e-4701-86f5-a2381ac9b820 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4bf2cc03-1e53-4dba-b9ee-f9974c74d419 req-b801718f-653e-4701-86f5-a2381ac9b820 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.compute.manager [req-4bf2cc03-1e53-4dba-b9ee-f9974c74d419 req-b801718f-653e-4701-86f5-a2381ac9b820 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:34 user nova-compute[73476]: WARNING nova.compute.manager [req-4bf2cc03-1e53-4dba-b9ee-f9974c74d419 req-b801718f-653e-4701-86f5-a2381ac9b820 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state building and task_state spawning.
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083214.0491972, 8644e702-6fc8-4c84-a208-ef9a78cda0ee => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:34 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] VM Resumed (Lifecycle Event)
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:53:34 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Instance spawned successfully.
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:34 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083214.0495398, 8644e702-6fc8-4c84-a208-ef9a78cda0ee => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:34 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] VM Started (Lifecycle Event)
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:34 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:34 user nova-compute[73476]: INFO nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 26 20:53:34 user nova-compute[73476]: DEBUG nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:34 user nova-compute[73476]: INFO nova.compute.manager [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Took 34.34 seconds to build instance.
Aug 26 20:53:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-65c3f0a9-dbd8-483d-8203-1426f292cc76 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.472s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:37 user nova-compute[73476]: INFO nova.compute.manager [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Unshelving
Aug 26 20:53:37 user nova-compute[73476]: INFO nova.virt.block_device [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Booting with volume 3538703d-e8cc-4ed6-a7ea-a4377639b36b at /dev/vda
Aug 26 20:53:37 user nova-compute[73476]: DEBUG os_brick.utils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee3e13f-6e2f-4753-befa-1c3e096cf177]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6397a6-152b-4ab0-98f3-fbe9ef50c03f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3db1cb-9c38-4074-8ae8-9f0a0821b1b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bca768e-3bd1-40f1-ac45-2e5e9243a736]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:53:37 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:53:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8e7df7-8ca0-4c18-963c-1463647cb3b7]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG os_brick.utils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:53:37 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating existing volume attachment record: cae3b528-c837-450c-9ca8-e31802a0a489 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:53:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:38 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:53:42 user nova-compute[73476]: INFO nova.compute.claims [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Claim successful on node user
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.800s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:53:43 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:53:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG nova.policy [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecd8ed063c144eb694017e5750ee57a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98519bcea11642e6b491b3a0cb4616db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:53:43 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Creating image(s)
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "/opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "/opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "/opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.220s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk 1073741824" returned: 0 in 0.062s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.900s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=6844MB free_disk=25.10186767578125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Cannot resize image /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Ensure instance console log exists: /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:53:45 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Creating image(s)
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Ensure instance console log exists: /opt/stack/data/nova/instances/aae763e2-8571-4c3f-91e3-4cc501b3d335/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Start _get_guest_xml network_info=[{"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'b61d611f-e20d-4c27-9391-37f67bae8435', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrEXBqAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aae763e2-8571-4c3f-91e3-4cc501b3d335', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5759c38-31d0-4814-b985-f3cdb3f80011', 'serial': 'f5759c38-31d0-4814-b985-f3cdb3f80011'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Successfully created port: 2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:53:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrEXBqAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:53:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:53:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:53:45 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1dddc689-a053-46d4-a29e-52c8fe78c76d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ed515d2d-7ad6-48bb-b353-abc4e620156c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ef7f0adb-9324-43ac-b3b7-593900b1576f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 08d4a50e-f447-43b0-9b57-9c73a9b11d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8644e702-6fc8-4c84-a208-ef9a78cda0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance aae763e2-8571-4c3f-91e3-4cc501b3d335 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[27322f70-e5c2-4f50-9715-ffa4b5b99b54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:53:45 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 6de9ed93-5d15-49cc-82fd-f4822fae54af has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 762ffba7-912d-40d7-af19-667df1760dc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf1261-4d7d-493e-a31d-59a82d9dc61f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011] added
Aug 26 20:53:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b756d68d-310a-463e-9e86-b22f203eabab]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3090896f-7bb4-4412-943c-d037c1486c98]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrEXBqAh {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrEXBqAh" returned: 0 in 0.035s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2524cab1-3ce5-479c-a2c9-2ad5bb61cb71]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LrEXBqAh'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a79e21-f700-4b7a-bb47-2c9a22f1bf37]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3c1d31-38be-4c8e-a9b7-902595de5b9d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0aa100-b416-4b1a-8c16-2162ed71c579]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011, portal: 172.16.0.220,3260]
Aug 26 20:53:45 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011, portal: 172.16.0.220,3260] successful.
Aug 26 20:53:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5984a-094b-4ccb-ac52-82ddd47c8c18]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1824a73c-a6c5-448f-b7bc-a05cb3118853]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:45 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a22b7-06a4-40fb-9ac1-692706dc1069]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.058s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Successfully updated port: 2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "refresh_cache-762ffba7-912d-40d7-af19-667df1760dc6" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquired lock "refresh_cache-762ffba7-912d-40d7-af19-667df1760dc6" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-389b3086-a835-4470-8c47-366707f2b24d req-32cb110b-9bb5-451d-a9e6-338da392be8d service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received event network-changed-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-389b3086-a835-4470-8c47-366707f2b24d req-32cb110b-9bb5-451d-a9e6-338da392be8d service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Refreshing instance network info cache due to event network-changed-2051ba09-6f5f-41b3-b088-5e4ef66c89bc. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-389b3086-a835-4470-8c47-366707f2b24d req-32cb110b-9bb5-451d-a9e6-338da392be8d service nova] Acquiring lock "refresh_cache-762ffba7-912d-40d7-af19-667df1760dc6" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:53:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrEXBqAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.541s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== connect_volume: return (1542ms) {'type': 'block', 'scsi_wwn': '23331343238343638', 'path': '/dev/sdd'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331343238343638', 'path': '/dev/sdd'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-275903418',display_name='tempest-ServerActionsTestOtherA-server-275903418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-275903418',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrUMTyGNKdGpzDsrysQPohyAkRqtJhi3sdBZorTU8L/A2dHf0ht3Zah6gdCoAeVQTlLTdvxBfzTJPbHDiEF3xFnMtXTZ/YbW5aEqOqGzGXK2CkdK6c5/YxdHT2BmY6wkQ==',key_name='tempest-keypair-2137585327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-mljsme95',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=aae763e2-8571-4c3f-91e3-4cc501b3d335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'pci_devices' on Instance uuid aae763e2-8571-4c3f-91e3-4cc501b3d335 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:53:47 user nova-compute[73476]:   <uuid>aae763e2-8571-4c3f-91e3-4cc501b3d335</uuid>
Aug 26 20:53:47 user nova-compute[73476]:   <name>instance-0000001e</name>
Aug 26 20:53:47 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:53:47 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:53:47 user nova-compute[73476]:   <metadata>
Aug 26 20:53:47 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:53:47 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:name>tempest-ServerActionsTestOtherA-server-275903418</nova:name>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:53:45</nova:creationTime>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:53:47 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:53:47 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:owner>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:user uuid="fdf18fb0dcd64e11a7e42cc5184a219e">tempest-ServerActionsTestOtherA-1600580756-project-member</nova:user>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:project uuid="b16d8f644f0442fea1f8a57961111a30">tempest-ServerActionsTestOtherA-1600580756</nova:project>
Aug 26 20:53:47 user nova-compute[73476]:       </nova:owner>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:ports>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:port uuid="a830ab77-92de-4d26-9371-0c133f6d2bf1">
Aug 26 20:53:47 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 20:53:47 user nova-compute[73476]:         </nova:port>
Aug 26 20:53:47 user nova-compute[73476]:       </nova:ports>
Aug 26 20:53:47 user nova-compute[73476]:     </nova:instance>
Aug 26 20:53:47 user nova-compute[73476]:   </metadata>
Aug 26 20:53:47 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:53:47 user nova-compute[73476]:     <system>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="serial">aae763e2-8571-4c3f-91e3-4cc501b3d335</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="uuid">aae763e2-8571-4c3f-91e3-4cc501b3d335</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:53:47 user nova-compute[73476]:     </system>
Aug 26 20:53:47 user nova-compute[73476]:   </sysinfo>
Aug 26 20:53:47 user nova-compute[73476]:   <os>
Aug 26 20:53:47 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:53:47 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:53:47 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:53:47 user nova-compute[73476]:   </os>
Aug 26 20:53:47 user nova-compute[73476]:   <features>
Aug 26 20:53:47 user nova-compute[73476]:     <acpi/>
Aug 26 20:53:47 user nova-compute[73476]:     <apic/>
Aug 26 20:53:47 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:53:47 user nova-compute[73476]:   </features>
Aug 26 20:53:47 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:53:47 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:53:47 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:53:47 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:53:47 user nova-compute[73476]:   </clock>
Aug 26 20:53:47 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:53:47 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:53:47 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:53:47 user nova-compute[73476]:   </cpu>
Aug 26 20:53:47 user nova-compute[73476]:   <devices>
Aug 26 20:53:47 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:53:47 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:53:47 user nova-compute[73476]:       <source dev="/dev/sdd"/>
Aug 26 20:53:47 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:53:47 user nova-compute[73476]:       <serial>f5759c38-31d0-4814-b985-f3cdb3f80011</serial>
Aug 26 20:53:47 user nova-compute[73476]:     </disk>
Aug 26 20:53:47 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:53:47 user nova-compute[73476]:       <mac address="fa:16:3e:fe:cc:bd"/>
Aug 26 20:53:47 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:47 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:53:47 user nova-compute[73476]:       <target dev="tapa830ab77-92"/>
Aug 26 20:53:47 user nova-compute[73476]:     </interface>
Aug 26 20:53:47 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:53:47 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/aae763e2-8571-4c3f-91e3-4cc501b3d335/console.log" append="off"/>
Aug 26 20:53:47 user nova-compute[73476]:     </serial>
Aug 26 20:53:47 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:53:47 user nova-compute[73476]:     <video>
Aug 26 20:53:47 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:47 user nova-compute[73476]:     </video>
Aug 26 20:53:47 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:53:47 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:53:47 user nova-compute[73476]:     </rng>
Aug 26 20:53:47 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:53:47 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:53:47 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:53:47 user nova-compute[73476]:     </memballoon>
Aug 26 20:53:47 user nova-compute[73476]:   </devices>
Aug 26 20:53:47 user nova-compute[73476]: </domain>
Aug 26 20:53:47 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-275903418',display_name='tempest-ServerActionsTestOtherA-server-275903418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-275903418',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrUMTyGNKdGpzDsrysQPohyAkRqtJhi3sdBZorTU8L/A2dHf0ht3Zah6gdCoAeVQTlLTdvxBfzTJPbHDiEF3xFnMtXTZ/YbW5aEqOqGzGXK2CkdK6c5/YxdHT2BmY6wkQ==',key_name='tempest-keypair-2137585327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-mljsme95',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=aae763e2-8571-4c3f-91e3-4cc501b3d335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG os_vif [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa830ab77-92, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa830ab77-92, col_values=(('external_ids', {'iface-id': 'a830ab77-92de-4d26-9371-0c133f6d2bf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:cc:bd', 'vm-uuid': 'aae763e2-8571-4c3f-91e3-4cc501b3d335'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:47 user nova-compute[73476]: INFO os_vif [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92')
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] No VIF found with MAC fa:16:3e:fe:cc:bd, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Updating instance_info_cache with network_info: [{"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Releasing lock "refresh_cache-762ffba7-912d-40d7-af19-667df1760dc6" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Instance network_info: |[{"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-389b3086-a835-4470-8c47-366707f2b24d req-32cb110b-9bb5-451d-a9e6-338da392be8d service nova] Acquired lock "refresh_cache-762ffba7-912d-40d7-af19-667df1760dc6" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.neutron [req-389b3086-a835-4470-8c47-366707f2b24d req-32cb110b-9bb5-451d-a9e6-338da392be8d service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Refreshing network info cache for port 2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Start _get_guest_xml network_info=[{"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:53:47 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:47 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-810120167',display_name='tempest-AttachVolumeNegativeTest-server-810120167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-810120167',id=31,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB326H1hORARohmS0QMx16K1kiab5CDxKToODqbp58mpvZV6rqdCYM9cq24gxeAM1azRytT+enqYJnkVjpumN6Df0QnTWE2ODxINasA6MzAliC9tS1l4O2oQiEKK/OOHnA==',key_name='tempest-keypair-1756930200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-ng58qqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=762ffba7-912d-40d7-af19-667df1760dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:be:90,bridge_name='br-int',has_traffic_filtering=True,id=2051ba09-6f5f-41b3-b088-5e4ef66c89bc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2051ba09-6f') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'pci_devices' on Instance uuid 762ffba7-912d-40d7-af19-667df1760dc6 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:53:47 user nova-compute[73476]:   <uuid>762ffba7-912d-40d7-af19-667df1760dc6</uuid>
Aug 26 20:53:47 user nova-compute[73476]:   <name>instance-0000001f</name>
Aug 26 20:53:47 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:53:47 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:53:47 user nova-compute[73476]:   <metadata>
Aug 26 20:53:47 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:53:47 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeNegativeTest-server-810120167</nova:name>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:53:47</nova:creationTime>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:53:47 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:53:47 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:owner>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:user uuid="ecd8ed063c144eb694017e5750ee57a9">tempest-AttachVolumeNegativeTest-745835648-project-member</nova:user>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:project uuid="98519bcea11642e6b491b3a0cb4616db">tempest-AttachVolumeNegativeTest-745835648</nova:project>
Aug 26 20:53:47 user nova-compute[73476]:       </nova:owner>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:53:47 user nova-compute[73476]:       <nova:ports>
Aug 26 20:53:47 user nova-compute[73476]:         <nova:port uuid="2051ba09-6f5f-41b3-b088-5e4ef66c89bc">
Aug 26 20:53:47 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 20:53:47 user nova-compute[73476]:         </nova:port>
Aug 26 20:53:47 user nova-compute[73476]:       </nova:ports>
Aug 26 20:53:47 user nova-compute[73476]:     </nova:instance>
Aug 26 20:53:47 user nova-compute[73476]:   </metadata>
Aug 26 20:53:47 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:53:47 user nova-compute[73476]:     <system>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="serial">762ffba7-912d-40d7-af19-667df1760dc6</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="uuid">762ffba7-912d-40d7-af19-667df1760dc6</entry>
Aug 26 20:53:47 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:53:47 user nova-compute[73476]:     </system>
Aug 26 20:53:47 user nova-compute[73476]:   </sysinfo>
Aug 26 20:53:47 user nova-compute[73476]:   <os>
Aug 26 20:53:47 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:53:47 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:53:47 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:53:47 user nova-compute[73476]:   </os>
Aug 26 20:53:47 user nova-compute[73476]:   <features>
Aug 26 20:53:47 user nova-compute[73476]:     <acpi/>
Aug 26 20:53:47 user nova-compute[73476]:     <apic/>
Aug 26 20:53:47 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:53:47 user nova-compute[73476]:   </features>
Aug 26 20:53:47 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:53:47 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:53:47 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:53:47 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:53:47 user nova-compute[73476]:   </clock>
Aug 26 20:53:47 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:53:47 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:53:47 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:53:47 user nova-compute[73476]:   </cpu>
Aug 26 20:53:47 user nova-compute[73476]:   <devices>
Aug 26 20:53:47 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:53:47 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:53:47 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk"/>
Aug 26 20:53:47 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:53:47 user nova-compute[73476]:     </disk>
Aug 26 20:53:47 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:53:47 user nova-compute[73476]:       <mac address="fa:16:3e:b2:be:90"/>
Aug 26 20:53:47 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:47 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:53:47 user nova-compute[73476]:       <target dev="tap2051ba09-6f"/>
Aug 26 20:53:47 user nova-compute[73476]:     </interface>
Aug 26 20:53:47 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:53:47 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/console.log" append="off"/>
Aug 26 20:53:47 user nova-compute[73476]:     </serial>
Aug 26 20:53:47 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:53:47 user nova-compute[73476]:     <video>
Aug 26 20:53:47 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:47 user nova-compute[73476]:     </video>
Aug 26 20:53:47 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:53:47 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:53:47 user nova-compute[73476]:     </rng>
Aug 26 20:53:47 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:53:47 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:53:47 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:53:47 user nova-compute[73476]:     </memballoon>
Aug 26 20:53:47 user nova-compute[73476]:   </devices>
Aug 26 20:53:47 user nova-compute[73476]: </domain>
Aug 26 20:53:47 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-810120167',display_name='tempest-AttachVolumeNegativeTest-server-810120167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-810120167',id=31,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB326H1hORARohmS0QMx16K1kiab5CDxKToODqbp58mpvZV6rqdCYM9cq24gxeAM1azRytT+enqYJnkVjpumN6Df0QnTWE2ODxINasA6MzAliC9tS1l4O2oQiEKK/OOHnA==',key_name='tempest-keypair-1756930200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-ng58qqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=762ffba7-912d-40d7-af19-667df1760dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:be:90,bridge_name='br-int',has_traffic_filtering=True,id=2051ba09-6f5f-41b3-b088-5e4ef66c89bc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2051ba09-6f') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG os_vif [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:be:90,bridge_name='br-int',has_traffic_filtering=True,id=2051ba09-6f5f-41b3-b088-5e4ef66c89bc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2051ba09-6f') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2051ba09-6f, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2051ba09-6f, col_values=(('external_ids', {'iface-id': '2051ba09-6f5f-41b3-b088-5e4ef66c89bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:be:90', 'vm-uuid': '762ffba7-912d-40d7-af19-667df1760dc6'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:47 user nova-compute[73476]: INFO os_vif [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:be:90,bridge_name='br-int',has_traffic_filtering=True,id=2051ba09-6f5f-41b3-b088-5e4ef66c89bc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2051ba09-6f')
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No VIF found with MAC fa:16:3e:b2:be:90, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.neutron [req-389b3086-a835-4470-8c47-366707f2b24d req-32cb110b-9bb5-451d-a9e6-338da392be8d service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Updated VIF entry in instance network info cache for port 2051ba09-6f5f-41b3-b088-5e4ef66c89bc. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG nova.network.neutron [req-389b3086-a835-4470-8c47-366707f2b24d req-32cb110b-9bb5-451d-a9e6-338da392be8d service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Updating instance_info_cache with network_info: [{"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-389b3086-a835-4470-8c47-366707f2b24d req-32cb110b-9bb5-451d-a9e6-338da392be8d service nova] Releasing lock "refresh_cache-762ffba7-912d-40d7-af19-667df1760dc6" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:48 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:53:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:53:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:53:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updating instance_info_cache with network_info: [{"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:53:49 user nova-compute[73476]: INFO nova.compute.claims [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Claim successful on node user
Aug 26 20:53:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-9335100d-e73e-4599-8de1-0d10dee0438a req-42faf31d-2d91-4b74-b9e0-57d18f477413 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received event network-vif-plugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9335100d-e73e-4599-8de1-0d10dee0438a req-42faf31d-2d91-4b74-b9e0-57d18f477413 service nova] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9335100d-e73e-4599-8de1-0d10dee0438a req-42faf31d-2d91-4b74-b9e0-57d18f477413 service nova] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9335100d-e73e-4599-8de1-0d10dee0438a req-42faf31d-2d91-4b74-b9e0-57d18f477413 service nova] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-9335100d-e73e-4599-8de1-0d10dee0438a req-42faf31d-2d91-4b74-b9e0-57d18f477413 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] No waiting events found dispatching network-vif-plugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:50 user nova-compute[73476]: WARNING nova.compute.manager [req-9335100d-e73e-4599-8de1-0d10dee0438a req-42faf31d-2d91-4b74-b9e0-57d18f477413 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received unexpected event network-vif-plugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc for instance with vm_state building and task_state spawning.
Aug 26 20:53:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-58b139a7-f961-466b-8f58-4d4b5e7911bf req-a89d639e-3065-4912-bcc0-7859d5a3dc72 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received event network-vif-plugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-58b139a7-f961-466b-8f58-4d4b5e7911bf req-a89d639e-3065-4912-bcc0-7859d5a3dc72 service nova] Acquiring lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-58b139a7-f961-466b-8f58-4d4b5e7911bf req-a89d639e-3065-4912-bcc0-7859d5a3dc72 service nova] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-58b139a7-f961-466b-8f58-4d4b5e7911bf req-a89d639e-3065-4912-bcc0-7859d5a3dc72 service nova] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-58b139a7-f961-466b-8f58-4d4b5e7911bf req-a89d639e-3065-4912-bcc0-7859d5a3dc72 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] No waiting events found dispatching network-vif-plugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:50 user nova-compute[73476]: WARNING nova.compute.manager [req-58b139a7-f961-466b-8f58-4d4b5e7911bf req-a89d639e-3065-4912-bcc0-7859d5a3dc72 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received unexpected event network-vif-plugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 for instance with vm_state building and task_state spawning.
Aug 26 20:53:50 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.007s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:53:51 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:53:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG nova.policy [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23d582475c914098b5c6dce6268c2e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fdd3e8e61d47bd8a50affae1854448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:53:51 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Creating image(s)
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.241s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk 1073741824" returned: 0 in 0.066s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.network.neutron [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Successfully created port: 6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.227s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Cannot resize image /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Ensure instance console log exists: /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-fcd8cb92-e0d3-4515-9960-d7d6c86efba0 req-7c8b0fd6-5023-420b-bbe4-71708b57daaf service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received event network-vif-plugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fcd8cb92-e0d3-4515-9960-d7d6c86efba0 req-7c8b0fd6-5023-420b-bbe4-71708b57daaf service nova] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fcd8cb92-e0d3-4515-9960-d7d6c86efba0 req-7c8b0fd6-5023-420b-bbe4-71708b57daaf service nova] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fcd8cb92-e0d3-4515-9960-d7d6c86efba0 req-7c8b0fd6-5023-420b-bbe4-71708b57daaf service nova] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-fcd8cb92-e0d3-4515-9960-d7d6c86efba0 req-7c8b0fd6-5023-420b-bbe4-71708b57daaf service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] No waiting events found dispatching network-vif-plugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:52 user nova-compute[73476]: WARNING nova.compute.manager [req-fcd8cb92-e0d3-4515-9960-d7d6c86efba0 req-7c8b0fd6-5023-420b-bbe4-71708b57daaf service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received unexpected event network-vif-plugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc for instance with vm_state building and task_state spawning.
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lazy-loading 'pci_requests' on Instance uuid 6de9ed93-5d15-49cc-82fd-f4822fae54af {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lazy-loading 'numa_topology' on Instance uuid 6de9ed93-5d15-49cc-82fd-f4822fae54af {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.compute.claims [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Claim successful on node user
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-7cc73a8e-e0e6-4733-a32a-c1787cd9efdc req-95b114f9-82e7-4786-857f-1d84afd081e4 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received event network-vif-plugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7cc73a8e-e0e6-4733-a32a-c1787cd9efdc req-95b114f9-82e7-4786-857f-1d84afd081e4 service nova] Acquiring lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7cc73a8e-e0e6-4733-a32a-c1787cd9efdc req-95b114f9-82e7-4786-857f-1d84afd081e4 service nova] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7cc73a8e-e0e6-4733-a32a-c1787cd9efdc req-95b114f9-82e7-4786-857f-1d84afd081e4 service nova] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-7cc73a8e-e0e6-4733-a32a-c1787cd9efdc req-95b114f9-82e7-4786-857f-1d84afd081e4 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] No waiting events found dispatching network-vif-plugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:52 user nova-compute[73476]: WARNING nova.compute.manager [req-7cc73a8e-e0e6-4733-a32a-c1787cd9efdc req-95b114f9-82e7-4786-857f-1d84afd081e4 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received unexpected event network-vif-plugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 for instance with vm_state building and task_state spawning.
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083232.7392266, aae763e2-8571-4c3f-91e3-4cc501b3d335 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] VM Resumed (Lifecycle Event)
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Instance spawned successfully.
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Instance spawned successfully.
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083232.7417278, aae763e2-8571-4c3f-91e3-4cc501b3d335 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] VM Started (Lifecycle Event)
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.network.neutron [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Successfully updated port: 6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Took 7.52 seconds to spawn the instance on the hypervisor.
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquired lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.network.neutron [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083232.789808, 762ffba7-912d-40d7-af19-667df1760dc6 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] VM Resumed (Lifecycle Event)
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-a859037a-c5f4-4ab0-802e-e11f57266c22 req-b3f71687-834a-436f-a8f5-a086710b8548 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-changed-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-a859037a-c5f4-4ab0-802e-e11f57266c22 req-b3f71687-834a-436f-a8f5-a086710b8548 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Refreshing instance network info cache due to event network-changed-6584605e-8134-4b8a-823b-c7fa91e9edf2. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a859037a-c5f4-4ab0-802e-e11f57266c22 req-b3f71687-834a-436f-a8f5-a086710b8548 service nova] Acquiring lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Took 9.29 seconds to spawn the instance on the hypervisor.
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:52 user nova-compute[73476]: INFO nova.compute.manager [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Took 31.76 seconds to build instance.
Aug 26 20:53:52 user nova-compute[73476]: DEBUG nova.network.neutron [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:53:53 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083232.7939568, 762ffba7-912d-40d7-af19-667df1760dc6 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:53 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] VM Started (Lifecycle Event)
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:53 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1747b3ef-e294-4ad8-83b1-4e85ed87a7d4 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.993s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:53 user nova-compute[73476]: INFO nova.compute.manager [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Took 10.68 seconds to build instance.
Aug 26 20:53:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0d796fdf-763c-4ca4-878b-924d097956c1 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.805s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating instance_info_cache with network_info: [{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Releasing lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance network_info: |[{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a859037a-c5f4-4ab0-802e-e11f57266c22 req-b3f71687-834a-436f-a8f5-a086710b8548 service nova] Acquired lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.network.neutron [req-a859037a-c5f4-4ab0-802e-e11f57266c22 req-b3f71687-834a-436f-a8f5-a086710b8548 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Refreshing network info cache for port 6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Start _get_guest_xml network_info=[{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:53:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.898s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1749490198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1749490198',id=32,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENYUdp9PpxnlBViq6RckJL4WVsGonAfQOV+tESM+2KUxv9mCIOfNWZgsfuu2Du6Q2DPctsZfXI/n6oQ7xLntfwWy4lyF0e1opIpDGuNToQE+SfJAFfeXDiXhMnu/kapFg==',key_name='tempest-keypair-2072190721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-alt09urc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=4fdf4aae-7ecd-448a-974d-56ff46abd39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.objects.instance [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:53:53 user nova-compute[73476]:   <uuid>4fdf4aae-7ecd-448a-974d-56ff46abd39a</uuid>
Aug 26 20:53:53 user nova-compute[73476]:   <name>instance-00000020</name>
Aug 26 20:53:53 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:53:53 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:53:53 user nova-compute[73476]:   <metadata>
Aug 26 20:53:53 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:53:53 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:53:53 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1749490198</nova:name>
Aug 26 20:53:53 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:53:53</nova:creationTime>
Aug 26 20:53:53 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:53:53 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:53:53 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:53:53 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:53:53 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:53:53 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:53:53 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:53:53 user nova-compute[73476]:       <nova:owner>
Aug 26 20:53:53 user nova-compute[73476]:         <nova:user uuid="23d582475c914098b5c6dce6268c2e2c">tempest-AttachVolumeShelveTestJSON-825342285-project-member</nova:user>
Aug 26 20:53:53 user nova-compute[73476]:         <nova:project uuid="69fdd3e8e61d47bd8a50affae1854448">tempest-AttachVolumeShelveTestJSON-825342285</nova:project>
Aug 26 20:53:53 user nova-compute[73476]:       </nova:owner>
Aug 26 20:53:53 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:53:53 user nova-compute[73476]:       <nova:ports>
Aug 26 20:53:53 user nova-compute[73476]:         <nova:port uuid="6584605e-8134-4b8a-823b-c7fa91e9edf2">
Aug 26 20:53:53 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 20:53:53 user nova-compute[73476]:         </nova:port>
Aug 26 20:53:53 user nova-compute[73476]:       </nova:ports>
Aug 26 20:53:53 user nova-compute[73476]:     </nova:instance>
Aug 26 20:53:53 user nova-compute[73476]:   </metadata>
Aug 26 20:53:53 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:53:53 user nova-compute[73476]:     <system>
Aug 26 20:53:53 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:53:53 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:53:53 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:53:53 user nova-compute[73476]:       <entry name="serial">4fdf4aae-7ecd-448a-974d-56ff46abd39a</entry>
Aug 26 20:53:53 user nova-compute[73476]:       <entry name="uuid">4fdf4aae-7ecd-448a-974d-56ff46abd39a</entry>
Aug 26 20:53:53 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:53:53 user nova-compute[73476]:     </system>
Aug 26 20:53:53 user nova-compute[73476]:   </sysinfo>
Aug 26 20:53:53 user nova-compute[73476]:   <os>
Aug 26 20:53:53 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:53:53 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:53:53 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:53:53 user nova-compute[73476]:   </os>
Aug 26 20:53:53 user nova-compute[73476]:   <features>
Aug 26 20:53:53 user nova-compute[73476]:     <acpi/>
Aug 26 20:53:53 user nova-compute[73476]:     <apic/>
Aug 26 20:53:53 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:53:53 user nova-compute[73476]:   </features>
Aug 26 20:53:53 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:53:53 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:53:53 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:53:53 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:53:53 user nova-compute[73476]:   </clock>
Aug 26 20:53:53 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:53:53 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:53:53 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:53:53 user nova-compute[73476]:   </cpu>
Aug 26 20:53:53 user nova-compute[73476]:   <devices>
Aug 26 20:53:53 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:53:53 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:53:53 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk"/>
Aug 26 20:53:53 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:53:53 user nova-compute[73476]:     </disk>
Aug 26 20:53:53 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:53:53 user nova-compute[73476]:       <mac address="fa:16:3e:6d:f5:96"/>
Aug 26 20:53:53 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:53 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:53:53 user nova-compute[73476]:       <target dev="tap6584605e-81"/>
Aug 26 20:53:53 user nova-compute[73476]:     </interface>
Aug 26 20:53:53 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:53:53 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/console.log" append="off"/>
Aug 26 20:53:53 user nova-compute[73476]:     </serial>
Aug 26 20:53:53 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:53:53 user nova-compute[73476]:     <video>
Aug 26 20:53:53 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:53 user nova-compute[73476]:     </video>
Aug 26 20:53:53 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:53:53 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:53:53 user nova-compute[73476]:     </rng>
Aug 26 20:53:53 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:53:53 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:53:53 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:53:53 user nova-compute[73476]:     </memballoon>
Aug 26 20:53:53 user nova-compute[73476]:   </devices>
Aug 26 20:53:53 user nova-compute[73476]: </domain>
Aug 26 20:53:53 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1749490198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1749490198',id=32,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENYUdp9PpxnlBViq6RckJL4WVsGonAfQOV+tESM+2KUxv9mCIOfNWZgsfuu2Du6Q2DPctsZfXI/n6oQ7xLntfwWy4lyF0e1opIpDGuNToQE+SfJAFfeXDiXhMnu/kapFg==',key_name='tempest-keypair-2072190721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-alt09urc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=4fdf4aae-7ecd-448a-974d-56ff46abd39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG os_vif [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6584605e-81, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6584605e-81, col_values=(('external_ids', {'iface-id': '6584605e-8134-4b8a-823b-c7fa91e9edf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:f5:96', 'vm-uuid': '4fdf4aae-7ecd-448a-974d-56ff46abd39a'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:53:53 user nova-compute[73476]: INFO nova.network.neutron [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating port d1598316-d7b5-4f58-947f-bee401d27b41 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:53 user nova-compute[73476]: INFO os_vif [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81')
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:53:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] No VIF found with MAC fa:16:3e:6d:f5:96, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-a859037a-c5f4-4ab0-802e-e11f57266c22 req-b3f71687-834a-436f-a8f5-a086710b8548 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updated VIF entry in instance network info cache for port 6584605e-8134-4b8a-823b-c7fa91e9edf2. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-a859037a-c5f4-4ab0-802e-e11f57266c22 req-b3f71687-834a-436f-a8f5-a086710b8548 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating instance_info_cache with network_info: [{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a859037a-c5f4-4ab0-802e-e11f57266c22 req-b3f71687-834a-436f-a8f5-a086710b8548 service nova] Releasing lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquired lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAtsSplQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:53:54 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:53:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:53:54 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:53:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:53:54 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:53:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-18f6cc0f-894b-4a25-b420-bb33af461129 req-955addf1-09fc-4831-853a-5db060f1c0a8 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-18f6cc0f-894b-4a25-b420-bb33af461129 req-955addf1-09fc-4831-853a-5db060f1c0a8 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing instance network info cache due to event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-18f6cc0f-894b-4a25-b420-bb33af461129 req-955addf1-09fc-4831-853a-5db060f1c0a8 service nova] Acquiring lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[863c1e88-72b2-49b2-b766-7d723b1b1d3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:53:54 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca8373d-9222-492b-9ec2-49bf6d880cf7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0] added
Aug 26 20:53:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24857ad-84a9-443c-bc2a-f911e09aee4f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba209839-bc5d-46cf-bf83-b71fa17804b7]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MAtsSplQ {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MAtsSplQ" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b458f2b4-e453-45ef-81b9-b701ebb2007a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MAtsSplQ'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[48194244-35d0-43a5-a131-deec030a2509]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d807fac-15df-4fb1-844f-97df9a5b523f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f9ffb0-9067-44f7-8f9c-30e1dd58620c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0, portal: 172.16.0.220,3260]
Aug 26 20:53:55 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0, portal: 172.16.0.220,3260] successful.
Aug 26 20:53:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[65236b99-6aeb-43cf-9ca6-f1de2e8f8c3c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e7a38a-7531-47fd-970d-ad7c14764ad8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)
Aug 26 20:53:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a35aa4-56f3-41c9-805f-49db09f4b187]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAtsSplQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-86b376d6-6851-493d-b749-51ca8606329f req-932507e3-957a-4a68-93d3-3444f1a06cc5 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-86b376d6-6851-493d-b749-51ca8606329f req-932507e3-957a-4a68-93d3-3444f1a06cc5 service nova] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-86b376d6-6851-493d-b749-51ca8606329f req-932507e3-957a-4a68-93d3-3444f1a06cc5 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-86b376d6-6851-493d-b749-51ca8606329f req-932507e3-957a-4a68-93d3-3444f1a06cc5 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-86b376d6-6851-493d-b749-51ca8606329f req-932507e3-957a-4a68-93d3-3444f1a06cc5 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] No waiting events found dispatching network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:55 user nova-compute[73476]: WARNING nova.compute.manager [req-86b376d6-6851-493d-b749-51ca8606329f req-932507e3-957a-4a68-93d3-3444f1a06cc5 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received unexpected event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 for instance with vm_state building and task_state spawning.
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating instance_info_cache with network_info: [{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Releasing lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:53:55 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Creating image(s)
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Ensure instance console log exists: /opt/stack/data/nova/instances/6de9ed93-5d15-49cc-82fd-f4822fae54af/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Start _get_guest_xml network_info=[{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'cae3b528-c837-450c-9ca8-e31802a0a489', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYQgzvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6de9ed93-5d15-49cc-82fd-f4822fae54af', 'attached_at': '', 'detached_at': '', 'volume_id': '3538703d-e8cc-4ed6-a7ea-a4377639b36b', 'serial': '3538703d-e8cc-4ed6-a7ea-a4377639b36b'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-18f6cc0f-894b-4a25-b420-bb33af461129 req-955addf1-09fc-4831-853a-5db060f1c0a8 service nova] Acquired lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.network.neutron [req-18f6cc0f-894b-4a25-b420-bb33af461129 req-955addf1-09fc-4831-853a-5db060f1c0a8 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:53:55 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:55 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6de9ed93-5d15-49cc-82fd-f4822fae54af {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:55 user nova-compute[73476]: DEBUG nova.objects.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Object Instance<6de9ed93-5d15-49cc-82fd-f4822fae54af> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYQgzvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:53:56 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '26466363230383661', 'path': '/dev/sde'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466363230383661', 'path': '/dev/sde'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.444s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:53:56 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:53:56 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG nova.objects.instance [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lazy-loading 'flavor' on Instance uuid ef7f0adb-9324-43ac-b3b7-593900b1576f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27eee1f-0035-49a1-a9b4-45f1f455e73d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:53:56 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:53:56 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:53:56 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:53:56 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:53:56 user nova-compute[73476]:   <serial>53f8ac9c-1764-4679-8161-df889b6b83c0</serial>
Aug 26 20:53:56 user nova-compute[73476]: </disk>
Aug 26 20:53:56 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27d63f8-6d8f-4867-a816-93d5bfd8a501]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b] added
Aug 26 20:53:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e515c749-de3c-43b6-be29-719a30db089f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0041daa0-ecbb-400d-9047-1302610fb94c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HYQgzvbJ {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HYQgzvbJ" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc99c172-e161-429a-92ea-10ef3639eb13]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HYQgzvbJ'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[59621447-b56b-44b2-be02-289832a7b18d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[649a0877-8e6e-4162-8865-1dd6763ab9a7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fe270f-7b38-46dc-bd94-dfccc1eb2107]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260]
Aug 26 20:53:56 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260] successful.
Aug 26 20:53:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef68850-b44c-41b9-803b-291a768cb6a6]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e5e3b9-6396-4ce6-8f54-bca02a347088]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:53:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)
Aug 26 20:53:56 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:53:56 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.478s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b9488f-a208-451f-b786-de7545c2a44b]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:53:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYQgzvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG nova.network.neutron [req-18f6cc0f-894b-4a25-b420-bb33af461129 req-955addf1-09fc-4831-853a-5db060f1c0a8 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updated VIF entry in instance network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG nova.network.neutron [req-18f6cc0f-894b-4a25-b420-bb33af461129 req-955addf1-09fc-4831-853a-5db060f1c0a8 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating instance_info_cache with network_info: [{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-18f6cc0f-894b-4a25-b420-bb33af461129 req-955addf1-09fc-4831-853a-5db060f1c0a8 service nova] Releasing lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] No VIF found with MAC fa:16:3e:7a:f3:2f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-236a4f54-3d71-4ba6-88ed-e010ac61cf22 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.250s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-474489e5-ee5d-4725-b064-648e6bacc7c4 req-df830324-7e5c-4296-98e9-f61fa86ccd38 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-474489e5-ee5d-4725-b064-648e6bacc7c4 req-df830324-7e5c-4296-98e9-f61fa86ccd38 service nova] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-474489e5-ee5d-4725-b064-648e6bacc7c4 req-df830324-7e5c-4296-98e9-f61fa86ccd38 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-474489e5-ee5d-4725-b064-648e6bacc7c4 req-df830324-7e5c-4296-98e9-f61fa86ccd38 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-474489e5-ee5d-4725-b064-648e6bacc7c4 req-df830324-7e5c-4296-98e9-f61fa86ccd38 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] No waiting events found dispatching network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:53:57 user nova-compute[73476]: WARNING nova.compute.manager [req-474489e5-ee5d-4725-b064-648e6bacc7c4 req-df830324-7e5c-4296-98e9-f61fa86ccd38 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received unexpected event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 for instance with vm_state building and task_state spawning.
Aug 26 20:53:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] <== connect_volume: return (1981ms) {'type': 'block', 'scsi_wwn': '23031326335373465', 'path': '/dev/sdf'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:53:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031326335373465', 'path': '/dev/sdf'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1052320475',display_name='tempest-TestShelveInstance-server-1052320475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1052320475',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1851856693',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f6d618e1c9c4d42bb6572b5dcc2596a',ramdisk_id='',reservation_id='r-h4v8vnt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1238211530',owner_user_name='tempest-TestShelveInstance-1238211530-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:53:38Z,user_data=None,user_id='c28d237e1730497f9b425a1b9bb1aaf5',uuid=6de9ed93-5d15-49cc-82fd-f4822fae54af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converting VIF {"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lazy-loading 'pci_devices' on Instance uuid 6de9ed93-5d15-49cc-82fd-f4822fae54af {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.objects.base [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Object Instance<6de9ed93-5d15-49cc-82fd-f4822fae54af> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:53:58 user nova-compute[73476]:   <uuid>6de9ed93-5d15-49cc-82fd-f4822fae54af</uuid>
Aug 26 20:53:58 user nova-compute[73476]:   <name>instance-00000016</name>
Aug 26 20:53:58 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:53:58 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:53:58 user nova-compute[73476]:   <metadata>
Aug 26 20:53:58 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:53:58 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:53:58 user nova-compute[73476]:       <nova:name>tempest-TestShelveInstance-server-1052320475</nova:name>
Aug 26 20:53:58 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:53:55</nova:creationTime>
Aug 26 20:53:58 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:53:58 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:53:58 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:53:58 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:53:58 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:53:58 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:53:58 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:53:58 user nova-compute[73476]:       <nova:owner>
Aug 26 20:53:58 user nova-compute[73476]:         <nova:user uuid="c28d237e1730497f9b425a1b9bb1aaf5">tempest-TestShelveInstance-1238211530-project-member</nova:user>
Aug 26 20:53:58 user nova-compute[73476]:         <nova:project uuid="8f6d618e1c9c4d42bb6572b5dcc2596a">tempest-TestShelveInstance-1238211530</nova:project>
Aug 26 20:53:58 user nova-compute[73476]:       </nova:owner>
Aug 26 20:53:58 user nova-compute[73476]:       <nova:ports>
Aug 26 20:53:58 user nova-compute[73476]:         <nova:port uuid="d1598316-d7b5-4f58-947f-bee401d27b41">
Aug 26 20:53:58 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 20:53:58 user nova-compute[73476]:         </nova:port>
Aug 26 20:53:58 user nova-compute[73476]:       </nova:ports>
Aug 26 20:53:58 user nova-compute[73476]:     </nova:instance>
Aug 26 20:53:58 user nova-compute[73476]:   </metadata>
Aug 26 20:53:58 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:53:58 user nova-compute[73476]:     <system>
Aug 26 20:53:58 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:53:58 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:53:58 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:53:58 user nova-compute[73476]:       <entry name="serial">6de9ed93-5d15-49cc-82fd-f4822fae54af</entry>
Aug 26 20:53:58 user nova-compute[73476]:       <entry name="uuid">6de9ed93-5d15-49cc-82fd-f4822fae54af</entry>
Aug 26 20:53:58 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:53:58 user nova-compute[73476]:     </system>
Aug 26 20:53:58 user nova-compute[73476]:   </sysinfo>
Aug 26 20:53:58 user nova-compute[73476]:   <os>
Aug 26 20:53:58 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:53:58 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:53:58 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:53:58 user nova-compute[73476]:   </os>
Aug 26 20:53:58 user nova-compute[73476]:   <features>
Aug 26 20:53:58 user nova-compute[73476]:     <acpi/>
Aug 26 20:53:58 user nova-compute[73476]:     <apic/>
Aug 26 20:53:58 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:53:58 user nova-compute[73476]:   </features>
Aug 26 20:53:58 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:53:58 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:53:58 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:53:58 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:53:58 user nova-compute[73476]:   </clock>
Aug 26 20:53:58 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:53:58 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:53:58 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:53:58 user nova-compute[73476]:   </cpu>
Aug 26 20:53:58 user nova-compute[73476]:   <devices>
Aug 26 20:53:58 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:53:58 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:53:58 user nova-compute[73476]:       <source dev="/dev/sdf"/>
Aug 26 20:53:58 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:53:58 user nova-compute[73476]:       <serial>3538703d-e8cc-4ed6-a7ea-a4377639b36b</serial>
Aug 26 20:53:58 user nova-compute[73476]:     </disk>
Aug 26 20:53:58 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:53:58 user nova-compute[73476]:       <mac address="fa:16:3e:b7:fa:1f"/>
Aug 26 20:53:58 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:58 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:53:58 user nova-compute[73476]:       <target dev="tapd1598316-d7"/>
Aug 26 20:53:58 user nova-compute[73476]:     </interface>
Aug 26 20:53:58 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:53:58 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/6de9ed93-5d15-49cc-82fd-f4822fae54af/console.log" append="off"/>
Aug 26 20:53:58 user nova-compute[73476]:     </serial>
Aug 26 20:53:58 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:53:58 user nova-compute[73476]:     <video>
Aug 26 20:53:58 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:53:58 user nova-compute[73476]:     </video>
Aug 26 20:53:58 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:53:58 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:53:58 user nova-compute[73476]:     </rng>
Aug 26 20:53:58 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:53:58 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:53:58 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:53:58 user nova-compute[73476]:     </memballoon>
Aug 26 20:53:58 user nova-compute[73476]:   </devices>
Aug 26 20:53:58 user nova-compute[73476]: </domain>
Aug 26 20:53:58 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1052320475',display_name='tempest-TestShelveInstance-server-1052320475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1052320475',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1851856693',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f6d618e1c9c4d42bb6572b5dcc2596a',ramdisk_id='',reservation_id='r-h4v8vnt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1238211530',owner_user_name='tempest-TestShelveInstance-1238211530-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:53:38Z,user_data=None,user_id='c28d237e1730497f9b425a1b9bb1aaf5',uuid=6de9ed93-5d15-49cc-82fd-f4822fae54af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converting VIF {"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG os_vif [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1598316-d7, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1598316-d7, col_values=(('external_ids', {'iface-id': 'd1598316-d7b5-4f58-947f-bee401d27b41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:fa:1f', 'vm-uuid': '6de9ed93-5d15-49cc-82fd-f4822fae54af'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:58 user nova-compute[73476]: INFO os_vif [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7')
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083238.107901, 4fdf4aae-7ecd-448a-974d-56ff46abd39a => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:58 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] VM Resumed (Lifecycle Event)
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:53:58 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance spawned successfully.
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:53:58 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083238.1149096, 4fdf4aae-7ecd-448a-974d-56ff46abd39a => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:53:58 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] VM Started (Lifecycle Event)
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] No VIF found with MAC fa:16:3e:b7:fa:1f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:53:58 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:53:58 user nova-compute[73476]: INFO nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Took 7.03 seconds to spawn the instance on the hypervisor.
Aug 26 20:53:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:53:58 user nova-compute[73476]: INFO nova.compute.manager [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Took 8.64 seconds to build instance.
Aug 26 20:53:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-71838d44-5210-4244-b53a-a11f89a00d98 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.825s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:53:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:53:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:53:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:53:59 user nova-compute[73476]: INFO nova.compute.manager [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Detaching volume 53f8ac9c-1764-4679-8161-df889b6b83c0
Aug 26 20:54:00 user nova-compute[73476]: INFO nova.virt.block_device [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Attempting to driver detach volume 53f8ac9c-1764-4679-8161-df889b6b83c0 from mountpoint /dev/vdb
Aug 26 20:54:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Attempting to detach device vdb from instance ef7f0adb-9324-43ac-b3b7-593900b1576f from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:54:00 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:54:00 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:54:00 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:54:00 user nova-compute[73476]:   <serial>53f8ac9c-1764-4679-8161-df889b6b83c0</serial>
Aug 26 20:54:00 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:54:00 user nova-compute[73476]: </disk>
Aug 26 20:54:00 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-83351fd5-d3af-421b-9bc7-835774310e51 req-ed510e02-bd2c-4909-9a27-7f5b3ea9d45b service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-83351fd5-d3af-421b-9bc7-835774310e51 req-ed510e02-bd2c-4909-9a27-7f5b3ea9d45b service nova] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-83351fd5-d3af-421b-9bc7-835774310e51 req-ed510e02-bd2c-4909-9a27-7f5b3ea9d45b service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-83351fd5-d3af-421b-9bc7-835774310e51 req-ed510e02-bd2c-4909-9a27-7f5b3ea9d45b service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-83351fd5-d3af-421b-9bc7-835774310e51 req-ed510e02-bd2c-4909-9a27-7f5b3ea9d45b service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] No waiting events found dispatching network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:00 user nova-compute[73476]: WARNING nova.compute.manager [req-83351fd5-d3af-421b-9bc7-835774310e51 req-ed510e02-bd2c-4909-9a27-7f5b3ea9d45b service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received unexpected event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 20:54:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Successfully detached device vdb from instance ef7f0adb-9324-43ac-b3b7-593900b1576f from the persistent domain config.
Aug 26 20:54:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef7f0adb-9324-43ac-b3b7-593900b1576f from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:54:00 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:54:00 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:54:00 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:54:00 user nova-compute[73476]:   <serial>53f8ac9c-1764-4679-8161-df889b6b83c0</serial>
Aug 26 20:54:00 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:54:00 user nova-compute[73476]: </disk>
Aug 26 20:54:00 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083240.6773257, ef7f0adb-9324-43ac-b3b7-593900b1576f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef7f0adb-9324-43ac-b3b7-593900b1576f {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:54:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Successfully detached device vdb from instance ef7f0adb-9324-43ac-b3b7-593900b1576f from the live domain config.
Aug 26 20:54:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MAtsSplQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:54:00 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[46abd418-2b8f-4877-8dc6-2f7abbf7214c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07024e5-8fc6-41f7-b71e-d76255d03a8e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:54:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 (non-flash)
Aug 26 20:54:00 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:54:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d01c31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0'): ({'sde'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Removing single pathed devices sde {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dbceb3-fd90-40ab-af4c-cb101ad870a1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc605e3c-0435-414f-aff2-86defb614650]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Flushing IO for device /dev/sde {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fbab68-a17c-43c3-865a-655664fc7a9e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.065s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7c7694-7bad-4394-b83d-1e84647d5269]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:54:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.118s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0e53d4-340a-4cf8-ac06-d22d5ff4eced]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7368e75c-06c1-4f36-8740-301643f5c107]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0, portal: 172.16.0.220,3260]
Aug 26 20:54:01 user nova-compute[73476]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0, portal: 172.16.0.220,3260] successful.
Aug 26 20:54:01 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f8ac9c-1764-4679-8161-df889b6b83c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e3cdc0-db57-4df3-8624-b87c5994a860]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] <== disconnect_volume: return (483ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:54:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:54:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-7017d1c0-07af-4b44-8572-6c20a6040cc7 req-4a96a66f-3b74-48b4-bbc4-e56d3b47e3e0 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7017d1c0-07af-4b44-8572-6c20a6040cc7 req-4a96a66f-3b74-48b4-bbc4-e56d3b47e3e0 service nova] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7017d1c0-07af-4b44-8572-6c20a6040cc7 req-4a96a66f-3b74-48b4-bbc4-e56d3b47e3e0 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7017d1c0-07af-4b44-8572-6c20a6040cc7 req-4a96a66f-3b74-48b4-bbc4-e56d3b47e3e0 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-7017d1c0-07af-4b44-8572-6c20a6040cc7 req-4a96a66f-3b74-48b4-bbc4-e56d3b47e3e0 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] No waiting events found dispatching network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:02 user nova-compute[73476]: WARNING nova.compute.manager [req-7017d1c0-07af-4b44-8572-6c20a6040cc7 req-4a96a66f-3b74-48b4-bbc4-e56d3b47e3e0 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received unexpected event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 20:54:02 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lazy-loading 'flavor' on Instance uuid ef7f0adb-9324-43ac-b3b7-593900b1576f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f897b8c-b6b3-4eee-85bf-75da391a7f4e tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.394s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:02 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083242.9078968, 6de9ed93-5d15-49cc-82fd-f4822fae54af => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:54:02 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] VM Resumed (Lifecycle Event)
Aug 26 20:54:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:54:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:54:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:54:03 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Instance spawned successfully.
Aug 26 20:54:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:03 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:54:03 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083242.9897463, 6de9ed93-5d15-49cc-82fd-f4822fae54af => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:54:03 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] VM Started (Lifecycle Event)
Aug 26 20:54:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:54:03 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:54:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d78756b1-ebcd-4dbb-ab10-192c49fe9a74 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.645s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:11 user nova-compute[73476]: INFO nova.compute.manager [None req-e2818025-ea4d-4400-b539-ad744253130a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Unrescuing
Aug 26 20:54:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2818025-ea4d-4400-b539-ad744253130a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:54:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2818025-ea4d-4400-b539-ad744253130a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquired lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:54:11 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e2818025-ea4d-4400-b539-ad744253130a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e2818025-ea4d-4400-b539-ad744253130a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating instance_info_cache with network_info: [{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e2818025-ea4d-4400-b539-ad744253130a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Releasing lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e2818025-ea4d-4400-b539-ad744253130a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'flavor' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-6e243d9c-af72-4b21-bf3b-3b8be5369eb0 req-84ed70b8-5e1c-4b09-b299-1d6202d819fa service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-unplugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6e243d9c-af72-4b21-bf3b-3b8be5369eb0 req-84ed70b8-5e1c-4b09-b299-1d6202d819fa service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6e243d9c-af72-4b21-bf3b-3b8be5369eb0 req-84ed70b8-5e1c-4b09-b299-1d6202d819fa service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6e243d9c-af72-4b21-bf3b-3b8be5369eb0 req-84ed70b8-5e1c-4b09-b299-1d6202d819fa service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-6e243d9c-af72-4b21-bf3b-3b8be5369eb0 req-84ed70b8-5e1c-4b09-b299-1d6202d819fa service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-unplugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:12 user nova-compute[73476]: WARNING nova.compute.manager [req-6e243d9c-af72-4b21-bf3b-3b8be5369eb0 req-84ed70b8-5e1c-4b09-b299-1d6202d819fa service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-unplugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:54:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:13 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Instance destroyed successfully.
Aug 26 20:54:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-97d7b4ef-a6e7-4645-a6d2-e872cfc3fd44 req-c345215b-9945-4116-abd0-62ee3b1fb451 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-97d7b4ef-a6e7-4645-a6d2-e872cfc3fd44 req-c345215b-9945-4116-abd0-62ee3b1fb451 service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-97d7b4ef-a6e7-4645-a6d2-e872cfc3fd44 req-c345215b-9945-4116-abd0-62ee3b1fb451 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-97d7b4ef-a6e7-4645-a6d2-e872cfc3fd44 req-c345215b-9945-4116-abd0-62ee3b1fb451 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-97d7b4ef-a6e7-4645-a6d2-e872cfc3fd44 req-c345215b-9945-4116-abd0-62ee3b1fb451 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:15 user nova-compute[73476]: WARNING nova.compute.manager [req-97d7b4ef-a6e7-4645-a6d2-e872cfc3fd44 req-c345215b-9945-4116-abd0-62ee3b1fb451 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:54:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:17 user nova-compute[73476]: WARNING nova.compute.manager [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:17 user nova-compute[73476]: WARNING nova.compute.manager [req-94645a01-002b-4018-9877-f999b05a287a req-7c93a5a6-f559-4a21-9e84-0dcc6f6864f9 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:17 user nova-compute[73476]: INFO nova.compute.manager [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Terminating instance
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for ed515d2d-7ad6-48bb-b353-abc4e620156c due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083257.2370162, ed515d2d-7ad6-48bb-b353-abc4e620156c => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:54:17 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] VM Resumed (Lifecycle Event)
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e2818025-ea4d-4400-b539-ad744253130a tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:17 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083257.2430127, ed515d2d-7ad6-48bb-b353-abc4e620156c => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:54:17 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] VM Started (Lifecycle Event)
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-fed88b56-1f14-4a82-bd48-1e095b0db1aa req-8edcec78-0935-4625-a4da-9b75fea53b8e service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received event network-vif-unplugged-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fed88b56-1f14-4a82-bd48-1e095b0db1aa req-8edcec78-0935-4625-a4da-9b75fea53b8e service nova] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fed88b56-1f14-4a82-bd48-1e095b0db1aa req-8edcec78-0935-4625-a4da-9b75fea53b8e service nova] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fed88b56-1f14-4a82-bd48-1e095b0db1aa req-8edcec78-0935-4625-a4da-9b75fea53b8e service nova] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-fed88b56-1f14-4a82-bd48-1e095b0db1aa req-8edcec78-0935-4625-a4da-9b75fea53b8e service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] No waiting events found dispatching network-vif-unplugged-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-fed88b56-1f14-4a82-bd48-1e095b0db1aa req-8edcec78-0935-4625-a4da-9b75fea53b8e service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received event network-vif-unplugged-478d7c28-392c-453d-81f0-e9775f156e9e for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:54:17 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Instance destroyed successfully.
Aug 26 20:54:17 user nova-compute[73476]: DEBUG nova.objects.instance [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lazy-loading 'resources' on Instance uuid 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-787487812',display_name='tempest-SnapshotDataIntegrityTests-server-787487812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-787487812',id=16,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFfX+CvjJMUoFtV8avxJq1PUGn4eYe0aVt2C6llbafDYn27z4msVfCKm6hj2Wev/M+MI+fsCXG3B7dIYNlXcPSe+oTVFKLmGqxv18Bv6UdvhgZcJm+3pW5uXoFFXNBCAw==',key_name='tempest-keypair-244704665',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97d40324fc0432ea4c7ac57cd0fe4b7',ramdisk_id='',reservation_id='r-tzrihpod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2133409530',owner_user_name='tempest-SnapshotDataIntegrityTests-2133409530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c8e36ae6a7f4edab7a006e199826ec6',uuid=94cfdb65-fd3d-4c46-bc38-f47b55edddd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Converting VIF {"id": "478d7c28-392c-453d-81f0-e9775f156e9e", "address": "fa:16:3e:b2:74:9f", "network": {"id": "091add1f-3e23-4c25-8e82-cb43df790f4d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1134092921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97d40324fc0432ea4c7ac57cd0fe4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478d7c28-39", "ovs_interfaceid": "478d7c28-392c-453d-81f0-e9775f156e9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:74:9f,bridge_name='br-int',has_traffic_filtering=True,id=478d7c28-392c-453d-81f0-e9775f156e9e,network=Network(091add1f-3e23-4c25-8e82-cb43df790f4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478d7c28-39') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG os_vif [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:74:9f,bridge_name='br-int',has_traffic_filtering=True,id=478d7c28-392c-453d-81f0-e9775f156e9e,network=Network(091add1f-3e23-4c25-8e82-cb43df790f4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478d7c28-39') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap478d7c28-39, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:54:18 user nova-compute[73476]: INFO os_vif [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:74:9f,bridge_name='br-int',has_traffic_filtering=True,id=478d7c28-392c-453d-81f0-e9775f156e9e,network=Network(091add1f-3e23-4c25-8e82-cb43df790f4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478d7c28-39')
Aug 26 20:54:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Deleting instance files /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9_del
Aug 26 20:54:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Deletion of /opt/stack/data/nova/instances/94cfdb65-fd3d-4c46-bc38-f47b55edddd9_del complete
Aug 26 20:54:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:18 user nova-compute[73476]: INFO nova.compute.manager [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 26 20:54:18 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:54:18 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:19 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Took 0.99 seconds to deallocate network for instance.
Aug 26 20:54:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-fd81891b-c62a-4d37-97f3-8b796d75f8d2 req-b4e95a73-cd2a-4142-8cee-77ed6f8af88c service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received event network-vif-plugged-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fd81891b-c62a-4d37-97f3-8b796d75f8d2 req-b4e95a73-cd2a-4142-8cee-77ed6f8af88c service nova] Acquiring lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fd81891b-c62a-4d37-97f3-8b796d75f8d2 req-b4e95a73-cd2a-4142-8cee-77ed6f8af88c service nova] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fd81891b-c62a-4d37-97f3-8b796d75f8d2 req-b4e95a73-cd2a-4142-8cee-77ed6f8af88c service nova] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-fd81891b-c62a-4d37-97f3-8b796d75f8d2 req-b4e95a73-cd2a-4142-8cee-77ed6f8af88c service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] No waiting events found dispatching network-vif-plugged-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:19 user nova-compute[73476]: WARNING nova.compute.manager [req-fd81891b-c62a-4d37-97f3-8b796d75f8d2 req-b4e95a73-cd2a-4142-8cee-77ed6f8af88c service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received unexpected event network-vif-plugged-478d7c28-392c-453d-81f0-e9775f156e9e for instance with vm_state deleted and task_state None.
Aug 26 20:54:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-fd81891b-c62a-4d37-97f3-8b796d75f8d2 req-b4e95a73-cd2a-4142-8cee-77ed6f8af88c service nova] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Received event network-vif-deleted-478d7c28-392c-453d-81f0-e9775f156e9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:54:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.571s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:19 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Deleted allocations for instance 94cfdb65-fd3d-4c46-bc38-f47b55edddd9
Aug 26 20:54:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ce356a47-e17b-41a2-8195-11a04d528d3a tempest-SnapshotDataIntegrityTests-2133409530 tempest-SnapshotDataIntegrityTests-2133409530-project-member] Lock "94cfdb65-fd3d-4c46-bc38-f47b55edddd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.926s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG nova.objects.instance [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'flavor' on Instance uuid d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:28 user nova-compute[73476]: INFO nova.compute.manager [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Attaching volume 99984eae-48cd-466d-a691-43213e3a84cf to /dev/vdb
Aug 26 20:54:28 user nova-compute[73476]: DEBUG os_brick.utils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef90cd0a-5b1d-41cd-af10-e3c175075b77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda856b7-168e-4c3b-888d-83f699e93034]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5bf895-c592-429c-b808-03f9a0802e32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1ec2bf-2a35-4dbf-8717-519f347516c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:54:28 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:54:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d85bf7-0432-4282-bec8-f2de50528f3b]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG os_brick.utils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:54:28 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updating existing volume attachment record: ceb08661-98d7-43f8-b21e-4b4b1cda0fdb {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:54:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquiring lock "e7f5df96-9852-49ee-b42a-0a1132e07efc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:54:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:30 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:54:30 user nova-compute[73476]: INFO nova.compute.claims [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Claim successful on node user
Aug 26 20:54:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:54:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:54:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:54:31 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:54:31 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:54:31 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Creating image(s)
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "/opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "/opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG nova.policy [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96c598813dad47f3a6b10fe907574b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314db0b9914f48d4bc0277dc913e76d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.248s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk 1073741824" returned: 0 in 0.061s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Cannot resize image /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Ensure instance console log exists: /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Successfully created port: d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:54:32 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083257.9730115, 94cfdb65-fd3d-4c46-bc38-f47b55edddd9 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:54:32 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] VM Stopped (Lifecycle Event)
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b43ac991-547e-4e59-9bb8-d2fb14f1e81e None None] [instance: 94cfdb65-fd3d-4c46-bc38-f47b55edddd9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Successfully updated port: d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquiring lock "refresh_cache-e7f5df96-9852-49ee-b42a-0a1132e07efc" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquired lock "refresh_cache-e7f5df96-9852-49ee-b42a-0a1132e07efc" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-eb4cface-0626-429f-87b7-caca5f020f5d req-6850e38c-c2eb-4ca2-a684-bbcac79e13f8 service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received event network-changed-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-eb4cface-0626-429f-87b7-caca5f020f5d req-6850e38c-c2eb-4ca2-a684-bbcac79e13f8 service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Refreshing instance network info cache due to event network-changed-d397682f-4084-45ae-a774-9bb14073ba36. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-eb4cface-0626-429f-87b7-caca5f020f5d req-6850e38c-c2eb-4ca2-a684-bbcac79e13f8 service nova] Acquiring lock "refresh_cache-e7f5df96-9852-49ee-b42a-0a1132e07efc" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Updating instance_info_cache with network_info: [{"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Releasing lock "refresh_cache-e7f5df96-9852-49ee-b42a-0a1132e07efc" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Instance network_info: |[{"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-eb4cface-0626-429f-87b7-caca5f020f5d req-6850e38c-c2eb-4ca2-a684-bbcac79e13f8 service nova] Acquired lock "refresh_cache-e7f5df96-9852-49ee-b42a-0a1132e07efc" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.network.neutron [req-eb4cface-0626-429f-87b7-caca5f020f5d req-6850e38c-c2eb-4ca2-a684-bbcac79e13f8 service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Refreshing network info cache for port d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Start _get_guest_xml network_info=[{"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:54:33 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:54:33 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-898052171',display_name='tempest-VolumesNegativeTest-instance-898052171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-898052171',id=33,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='314db0b9914f48d4bc0277dc913e76d6',ramdisk_id='',reservation_id='r-j2pjonoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-398040337',owner_user_name='tempest-VolumesNegativeTest-398040337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:54:31Z,user_data=None,user_id='96c598813dad47f3a6b10fe907574b1b',uuid=e7f5df96-9852-49ee-b42a-0a1132e07efc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Converting VIF {"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c5:9e,bridge_name='br-int',has_traffic_filtering=True,id=d397682f-4084-45ae-a774-9bb14073ba36,network=Network(53f0d360-df05-463a-bda0-b8d1e7bbb817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd397682f-40') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lazy-loading 'pci_devices' on Instance uuid e7f5df96-9852-49ee-b42a-0a1132e07efc {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:54:33 user nova-compute[73476]:   <uuid>e7f5df96-9852-49ee-b42a-0a1132e07efc</uuid>
Aug 26 20:54:33 user nova-compute[73476]:   <name>instance-00000021</name>
Aug 26 20:54:33 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:54:33 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:54:33 user nova-compute[73476]:   <metadata>
Aug 26 20:54:33 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:54:33 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:54:33 user nova-compute[73476]:       <nova:name>tempest-VolumesNegativeTest-instance-898052171</nova:name>
Aug 26 20:54:33 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:54:33</nova:creationTime>
Aug 26 20:54:33 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:54:33 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:54:33 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:54:33 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:54:33 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:54:33 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:54:33 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:54:33 user nova-compute[73476]:       <nova:owner>
Aug 26 20:54:33 user nova-compute[73476]:         <nova:user uuid="96c598813dad47f3a6b10fe907574b1b">tempest-VolumesNegativeTest-398040337-project-member</nova:user>
Aug 26 20:54:33 user nova-compute[73476]:         <nova:project uuid="314db0b9914f48d4bc0277dc913e76d6">tempest-VolumesNegativeTest-398040337</nova:project>
Aug 26 20:54:33 user nova-compute[73476]:       </nova:owner>
Aug 26 20:54:33 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:54:33 user nova-compute[73476]:       <nova:ports>
Aug 26 20:54:33 user nova-compute[73476]:         <nova:port uuid="d397682f-4084-45ae-a774-9bb14073ba36">
Aug 26 20:54:33 user nova-compute[73476]:           <nova:ip type="fixed" address="192.168.233.118" ipVersion="4"/>
Aug 26 20:54:33 user nova-compute[73476]:         </nova:port>
Aug 26 20:54:33 user nova-compute[73476]:       </nova:ports>
Aug 26 20:54:33 user nova-compute[73476]:     </nova:instance>
Aug 26 20:54:33 user nova-compute[73476]:   </metadata>
Aug 26 20:54:33 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:54:33 user nova-compute[73476]:     <system>
Aug 26 20:54:33 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:54:33 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:54:33 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:54:33 user nova-compute[73476]:       <entry name="serial">e7f5df96-9852-49ee-b42a-0a1132e07efc</entry>
Aug 26 20:54:33 user nova-compute[73476]:       <entry name="uuid">e7f5df96-9852-49ee-b42a-0a1132e07efc</entry>
Aug 26 20:54:33 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:54:33 user nova-compute[73476]:     </system>
Aug 26 20:54:33 user nova-compute[73476]:   </sysinfo>
Aug 26 20:54:33 user nova-compute[73476]:   <os>
Aug 26 20:54:33 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:54:33 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:54:33 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:54:33 user nova-compute[73476]:   </os>
Aug 26 20:54:33 user nova-compute[73476]:   <features>
Aug 26 20:54:33 user nova-compute[73476]:     <acpi/>
Aug 26 20:54:33 user nova-compute[73476]:     <apic/>
Aug 26 20:54:33 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:54:33 user nova-compute[73476]:   </features>
Aug 26 20:54:33 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:54:33 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:54:33 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:54:33 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:54:33 user nova-compute[73476]:   </clock>
Aug 26 20:54:33 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:54:33 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:54:33 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:54:33 user nova-compute[73476]:   </cpu>
Aug 26 20:54:33 user nova-compute[73476]:   <devices>
Aug 26 20:54:33 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:54:33 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:54:33 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk"/>
Aug 26 20:54:33 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:54:33 user nova-compute[73476]:     </disk>
Aug 26 20:54:33 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:54:33 user nova-compute[73476]:       <mac address="fa:16:3e:e0:c5:9e"/>
Aug 26 20:54:33 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:54:33 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:54:33 user nova-compute[73476]:       <target dev="tapd397682f-40"/>
Aug 26 20:54:33 user nova-compute[73476]:     </interface>
Aug 26 20:54:33 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:54:33 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/console.log" append="off"/>
Aug 26 20:54:33 user nova-compute[73476]:     </serial>
Aug 26 20:54:33 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:54:33 user nova-compute[73476]:     <video>
Aug 26 20:54:33 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:54:33 user nova-compute[73476]:     </video>
Aug 26 20:54:33 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:54:33 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:54:33 user nova-compute[73476]:     </rng>
Aug 26 20:54:33 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:54:33 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:54:33 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:54:33 user nova-compute[73476]:     </memballoon>
Aug 26 20:54:33 user nova-compute[73476]:   </devices>
Aug 26 20:54:33 user nova-compute[73476]: </domain>
Aug 26 20:54:33 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-898052171',display_name='tempest-VolumesNegativeTest-instance-898052171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-898052171',id=33,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='314db0b9914f48d4bc0277dc913e76d6',ramdisk_id='',reservation_id='r-j2pjonoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-398040337',owner_user_name='tempest-VolumesNegativeTest-398040337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:54:31Z,user_data=None,user_id='96c598813dad47f3a6b10fe907574b1b',uuid=e7f5df96-9852-49ee-b42a-0a1132e07efc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Converting VIF {"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c5:9e,bridge_name='br-int',has_traffic_filtering=True,id=d397682f-4084-45ae-a774-9bb14073ba36,network=Network(53f0d360-df05-463a-bda0-b8d1e7bbb817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd397682f-40') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG os_vif [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c5:9e,bridge_name='br-int',has_traffic_filtering=True,id=d397682f-4084-45ae-a774-9bb14073ba36,network=Network(53f0d360-df05-463a-bda0-b8d1e7bbb817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd397682f-40') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd397682f-40, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd397682f-40, col_values=(('external_ids', {'iface-id': 'd397682f-4084-45ae-a774-9bb14073ba36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:c5:9e', 'vm-uuid': 'e7f5df96-9852-49ee-b42a-0a1132e07efc'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:33 user nova-compute[73476]: INFO os_vif [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c5:9e,bridge_name='br-int',has_traffic_filtering=True,id=d397682f-4084-45ae-a774-9bb14073ba36,network=Network(53f0d360-df05-463a-bda0-b8d1e7bbb817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd397682f-40')
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:54:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] No VIF found with MAC fa:16:3e:e0:c5:9e, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:54:34 user nova-compute[73476]: DEBUG nova.network.neutron [req-eb4cface-0626-429f-87b7-caca5f020f5d req-6850e38c-c2eb-4ca2-a684-bbcac79e13f8 service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Updated VIF entry in instance network info cache for port d397682f-4084-45ae-a774-9bb14073ba36. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:54:34 user nova-compute[73476]: DEBUG nova.network.neutron [req-eb4cface-0626-429f-87b7-caca5f020f5d req-6850e38c-c2eb-4ca2-a684-bbcac79e13f8 service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Updating instance_info_cache with network_info: [{"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-eb4cface-0626-429f-87b7-caca5f020f5d req-6850e38c-c2eb-4ca2-a684-bbcac79e13f8 service nova] Releasing lock "refresh_cache-e7f5df96-9852-49ee-b42a-0a1132e07efc" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-60b1592e-d69a-4f8c-84ce-e6d0c46260bd req-30c052df-7fb2-40af-a8c0-a4e1606fa68b service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received event network-vif-plugged-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-60b1592e-d69a-4f8c-84ce-e6d0c46260bd req-30c052df-7fb2-40af-a8c0-a4e1606fa68b service nova] Acquiring lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-60b1592e-d69a-4f8c-84ce-e6d0c46260bd req-30c052df-7fb2-40af-a8c0-a4e1606fa68b service nova] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-60b1592e-d69a-4f8c-84ce-e6d0c46260bd req-30c052df-7fb2-40af-a8c0-a4e1606fa68b service nova] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-60b1592e-d69a-4f8c-84ce-e6d0c46260bd req-30c052df-7fb2-40af-a8c0-a4e1606fa68b service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] No waiting events found dispatching network-vif-plugged-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:35 user nova-compute[73476]: WARNING nova.compute.manager [req-60b1592e-d69a-4f8c-84ce-e6d0c46260bd req-30c052df-7fb2-40af-a8c0-a4e1606fa68b service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received unexpected event network-vif-plugged-d397682f-4084-45ae-a774-9bb14073ba36 for instance with vm_state building and task_state spawning.
Aug 26 20:54:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:54:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083277.249062, e7f5df96-9852-49ee-b42a-0a1132e07efc => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:54:37 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] VM Resumed (Lifecycle Event)
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:54:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Instance spawned successfully.
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:54:37 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083277.2528021, e7f5df96-9852-49ee-b42a-0a1132e07efc => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:54:37 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] VM Started (Lifecycle Event)
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:54:37 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:54:37 user nova-compute[73476]: INFO nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-cd602b09-601d-4a66-87ee-4286190de08f req-8e574d7b-1ee5-4284-972d-8a9f0165b560 service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received event network-vif-plugged-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cd602b09-601d-4a66-87ee-4286190de08f req-8e574d7b-1ee5-4284-972d-8a9f0165b560 service nova] Acquiring lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cd602b09-601d-4a66-87ee-4286190de08f req-8e574d7b-1ee5-4284-972d-8a9f0165b560 service nova] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cd602b09-601d-4a66-87ee-4286190de08f req-8e574d7b-1ee5-4284-972d-8a9f0165b560 service nova] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-cd602b09-601d-4a66-87ee-4286190de08f req-8e574d7b-1ee5-4284-972d-8a9f0165b560 service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] No waiting events found dispatching network-vif-plugged-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:37 user nova-compute[73476]: WARNING nova.compute.manager [req-cd602b09-601d-4a66-87ee-4286190de08f req-8e574d7b-1ee5-4284-972d-8a9f0165b560 service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received unexpected event network-vif-plugged-d397682f-4084-45ae-a774-9bb14073ba36 for instance with vm_state building and task_state spawning.
Aug 26 20:54:37 user nova-compute[73476]: INFO nova.compute.manager [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Took 6.92 seconds to build instance.
Aug 26 20:54:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9eb36cca-4853-487a-804c-b09ac85fc90c tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.019s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:54:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:54:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:54:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:38 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:54:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:54:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:54:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWMRTZgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:54:41 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:54:41 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:54:41 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b86517-be0e-4691-b606-b88aecea2fb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:54:41 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[594acaed-f13e-4c14-8144-5133ce755f69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf] added
Aug 26 20:54:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc106870-2700-42c6-83b3-9dfd9fcae521]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc4fc72-430b-4d95-9098-e323f371d627]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWMRTZgd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oWMRTZgd" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67e440-9e62-487f-a259-25c7724481ff]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oWMRTZgd'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d31b4d-2f53-4617-b43a-c9346a37250d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac1b5c9-ccc9-4c80-9322-5fdea245c55f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:54:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:54:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb5a751-7345-4863-8844-6bb90a9a0563]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf, portal: 172.16.0.220,3260]
Aug 26 20:54:41 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf, portal: 172.16.0.220,3260] successful.
Aug 26 20:54:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6204b96-2f97-4e4c-88ba-9a6e3f357677]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe28350-d3cf-4377-98e6-f164bfe89dac]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:54:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:54:41 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:54:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[072acb01-2856-4b53-82bf-f7752657f474]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWMRTZgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23965353936383962', 'path': '/dev/sde'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965353936383962', 'path': '/dev/sde'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG nova.objects.instance [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'flavor' on Instance uuid d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:54:42 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:54:42 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:54:42 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:54:42 user nova-compute[73476]:   <serial>99984eae-48cd-466d-a691-43213e3a84cf</serial>
Aug 26 20:54:42 user nova-compute[73476]: </disk>
Aug 26 20:54:42 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:54:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] No VIF found with MAC fa:16:3e:e5:38:1d, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-31df31ed-8907-436d-966f-6058e75cd4e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.829s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:44 user nova-compute[73476]: INFO nova.compute.manager [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Terminating instance
Aug 26 20:54:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ef257ea-fb1e-4f33-a128-bdc87ccfa8f2 req-7d285f95-78a9-47ed-8f9b-7f335aebe2e3 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-unplugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ef257ea-fb1e-4f33-a128-bdc87ccfa8f2 req-7d285f95-78a9-47ed-8f9b-7f335aebe2e3 service nova] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ef257ea-fb1e-4f33-a128-bdc87ccfa8f2 req-7d285f95-78a9-47ed-8f9b-7f335aebe2e3 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ef257ea-fb1e-4f33-a128-bdc87ccfa8f2 req-7d285f95-78a9-47ed-8f9b-7f335aebe2e3 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ef257ea-fb1e-4f33-a128-bdc87ccfa8f2 req-7d285f95-78a9-47ed-8f9b-7f335aebe2e3 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] No waiting events found dispatching network-vif-unplugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ef257ea-fb1e-4f33-a128-bdc87ccfa8f2 req-7d285f95-78a9-47ed-8f9b-7f335aebe2e3 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-unplugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:54:45 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Instance destroyed successfully.
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.objects.instance [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lazy-loading 'resources' on Instance uuid 08d4a50e-f447-43b0-9b57-9c73a9b11d3e {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:54:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=6074MB free_disk=25.057376861572266GB free_vcpus=-5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1671664455',display_name='tempest-VolumesActionsTest-instance-1671664455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1671664455',id=27,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='166fe05519d74dd78e3228e47ef09e90',ramdisk_id='',reservation_id='r-vvh4rgqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-562295190',owner_user_name='tempest-VolumesActionsTest-562295190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:53:01Z,user_data=None,user_id='d38f2a23de67450a825596c77fe9dbf2',uuid=08d4a50e-f447-43b0-9b57-9c73a9b11d3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "address": "fa:16:3e:67:af:7b", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba57062-58", "ovs_interfaceid": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converting VIF {"id": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "address": "fa:16:3e:67:af:7b", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba57062-58", "ovs_interfaceid": "bba57062-58f4-47ce-99cf-792a4fdb81c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:af:7b,bridge_name='br-int',has_traffic_filtering=True,id=bba57062-58f4-47ce-99cf-792a4fdb81c3,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba57062-58') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG os_vif [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:af:7b,bridge_name='br-int',has_traffic_filtering=True,id=bba57062-58f4-47ce-99cf-792a4fdb81c3,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba57062-58') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbba57062-58, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:54:45 user nova-compute[73476]: INFO os_vif [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:af:7b,bridge_name='br-int',has_traffic_filtering=True,id=bba57062-58f4-47ce-99cf-792a4fdb81c3,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba57062-58')
Aug 26 20:54:45 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Deleting instance files /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e_del
Aug 26 20:54:45 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Deletion of /opt/stack/data/nova/instances/08d4a50e-f447-43b0-9b57-9c73a9b11d3e_del complete
Aug 26 20:54:45 user nova-compute[73476]: INFO nova.compute.manager [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Took 1.43 seconds to destroy the instance on the hypervisor.
Aug 26 20:54:45 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1dddc689-a053-46d4-a29e-52c8fe78c76d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ed515d2d-7ad6-48bb-b353-abc4e620156c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ef7f0adb-9324-43ac-b3b7-593900b1576f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 08d4a50e-f447-43b0-9b57-9c73a9b11d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8644e702-6fc8-4c84-a208-ef9a78cda0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance aae763e2-8571-4c3f-91e3-4cc501b3d335 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 6de9ed93-5d15-49cc-82fd-f4822fae54af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 762ffba7-912d-40d7-af19-667df1760dc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e7f5df96-9852-49ee-b42a-0a1132e07efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=17 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.962s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] No waiting events found dispatching network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:46 user nova-compute[73476]: WARNING nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received unexpected event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 for instance with vm_state active and task_state deleting.
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] No waiting events found dispatching network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:46 user nova-compute[73476]: WARNING nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received unexpected event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 for instance with vm_state active and task_state deleting.
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] No waiting events found dispatching network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:46 user nova-compute[73476]: WARNING nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received unexpected event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 for instance with vm_state active and task_state deleting.
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-unplugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] No waiting events found dispatching network-vif-unplugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-unplugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Acquiring lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] No waiting events found dispatching network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:46 user nova-compute[73476]: WARNING nova.compute.manager [req-946d7562-8a70-4003-942c-b2066b56638d req-f072da79-171f-4c2d-b637-9378ee1c5759 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received unexpected event network-vif-plugged-bba57062-58f4-47ce-99cf-792a4fdb81c3 for instance with vm_state active and task_state deleting.
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:46 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Took 1.29 seconds to deallocate network for instance.
Aug 26 20:54:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-641b074b-d1aa-47e3-a1eb-78a14522a8e9 req-618238e6-5d04-47b9-a63d-58d298e63027 service nova] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Received event network-vif-deleted-bba57062-58f4-47ce-99cf-792a4fdb81c3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-451569fe-0206-42f7-90ff-65bce8559780 req-e2512012-3507-4854-95b1-eceaa22e467c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-changed-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-451569fe-0206-42f7-90ff-65bce8559780 req-e2512012-3507-4854-95b1-eceaa22e467c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Refreshing instance network info cache due to event network-changed-4fbe332d-e987-48c7-9ddf-94e0e0427864. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-451569fe-0206-42f7-90ff-65bce8559780 req-e2512012-3507-4854-95b1-eceaa22e467c service nova] Acquiring lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-451569fe-0206-42f7-90ff-65bce8559780 req-e2512012-3507-4854-95b1-eceaa22e467c service nova] Acquired lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG nova.network.neutron [req-451569fe-0206-42f7-90ff-65bce8559780 req-e2512012-3507-4854-95b1-eceaa22e467c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Refreshing network info cache for port 4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:54:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:47 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Deleted allocations for instance 08d4a50e-f447-43b0-9b57-9c73a9b11d3e
Aug 26 20:54:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b68a9b9c-51c8-47e4-82a6-a31f2362bb00 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "08d4a50e-f447-43b0-9b57-9c73a9b11d3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.493s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-451569fe-0206-42f7-90ff-65bce8559780 req-e2512012-3507-4854-95b1-eceaa22e467c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updated VIF entry in instance network info cache for port 4fbe332d-e987-48c7-9ddf-94e0e0427864. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:54:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-451569fe-0206-42f7-90ff-65bce8559780 req-e2512012-3507-4854-95b1-eceaa22e467c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-451569fe-0206-42f7-90ff-65bce8559780 req-e2512012-3507-4854-95b1-eceaa22e467c service nova] Releasing lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:54:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:48 user nova-compute[73476]: INFO nova.compute.manager [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] instance snapshotting
Aug 26 20:54:48 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:54:48 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:54:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:54:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Beginning live snapshot process
Aug 26 20:54:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 20:54:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json -f qcow2 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-992347e2-e548-4075-8474-345d1596c0d9 req-af839f4f-853e-4f30-9aa9-3860ef0b2bfa service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-992347e2-e548-4075-8474-345d1596c0d9 req-af839f4f-853e-4f30-9aa9-3860ef0b2bfa service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing instance network info cache due to event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-992347e2-e548-4075-8474-345d1596c0d9 req-af839f4f-853e-4f30-9aa9-3860ef0b2bfa service nova] Acquiring lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-992347e2-e548-4075-8474-345d1596c0d9 req-af839f4f-853e-4f30-9aa9-3860ef0b2bfa service nova] Acquired lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-992347e2-e548-4075-8474-345d1596c0d9 req-af839f4f-853e-4f30-9aa9-3860ef0b2bfa service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json -f qcow2 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.175s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd14q8hpn/2ef0749c283743c88316b28d4db57e90.delta 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd14q8hpn/2ef0749c283743c88316b28d4db57e90.delta 1073741824" returned: 0 in 0.058s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 20:54:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-992347e2-e548-4075-8474-345d1596c0d9 req-af839f4f-853e-4f30-9aa9-3860ef0b2bfa service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updated VIF entry in instance network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-992347e2-e548-4075-8474-345d1596c0d9 req-af839f4f-853e-4f30-9aa9-3860ef0b2bfa service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updating instance_info_cache with network_info: [{"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-992347e2-e548-4075-8474-345d1596c0d9 req-af839f4f-853e-4f30-9aa9-3860ef0b2bfa service nova] Releasing lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-25ecea70-f451-4bc3-867c-1a98fe48a35a req-ffffac1c-049e-4898-b514-7c9e95a6b179 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-25ecea70-f451-4bc3-867c-1a98fe48a35a req-ffffac1c-049e-4898-b514-7c9e95a6b179 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing instance network info cache due to event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-25ecea70-f451-4bc3-867c-1a98fe48a35a req-ffffac1c-049e-4898-b514-7c9e95a6b179 service nova] Acquiring lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-25ecea70-f451-4bc3-867c-1a98fe48a35a req-ffffac1c-049e-4898-b514-7c9e95a6b179 service nova] Acquired lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:54:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-25ecea70-f451-4bc3-867c-1a98fe48a35a req-ffffac1c-049e-4898-b514-7c9e95a6b179 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG nova.network.neutron [req-25ecea70-f451-4bc3-867c-1a98fe48a35a req-ffffac1c-049e-4898-b514-7c9e95a6b179 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updated VIF entry in instance network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG nova.network.neutron [req-25ecea70-f451-4bc3-867c-1a98fe48a35a req-ffffac1c-049e-4898-b514-7c9e95a6b179 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updating instance_info_cache with network_info: [{"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-25ecea70-f451-4bc3-867c-1a98fe48a35a req-ffffac1c-049e-4898-b514-7c9e95a6b179 service nova] Releasing lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:50 user nova-compute[73476]: INFO nova.compute.manager [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Rebooting instance
Aug 26 20:54:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquired lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 20:54:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 20:54:50 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:54:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd14q8hpn/2ef0749c283743c88316b28d4db57e90.delta /opt/stack/data/nova/instances/snapshots/tmpd14q8hpn/2ef0749c283743c88316b28d4db57e90 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:51 user nova-compute[73476]: INFO nova.compute.manager [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Rescuing
Aug 26 20:54:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:54:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquired lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:54:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:54:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updating instance_info_cache with network_info: [{"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Releasing lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:54:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:54:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd14q8hpn/2ef0749c283743c88316b28d4db57e90.delta /opt/stack/data/nova/instances/snapshots/tmpd14q8hpn/2ef0749c283743c88316b28d4db57e90" returned: 0 in 0.693s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:51 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Snapshot extracted, beginning image upload
Aug 26 20:54:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Updating instance_info_cache with network_info: [{"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:54:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Releasing lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:54:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4ebef1c-3635-46b3-8929-1a220a80a695 req-b840f31a-b688-41ef-8447-7b8b1dba616e service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-unplugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4ebef1c-3635-46b3-8929-1a220a80a695 req-b840f31a-b688-41ef-8447-7b8b1dba616e service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4ebef1c-3635-46b3-8929-1a220a80a695 req-b840f31a-b688-41ef-8447-7b8b1dba616e service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4ebef1c-3635-46b3-8929-1a220a80a695 req-b840f31a-b688-41ef-8447-7b8b1dba616e service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4ebef1c-3635-46b3-8929-1a220a80a695 req-b840f31a-b688-41ef-8447-7b8b1dba616e service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-unplugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:52 user nova-compute[73476]: WARNING nova.compute.manager [req-f4ebef1c-3635-46b3-8929-1a220a80a695 req-b840f31a-b688-41ef-8447-7b8b1dba616e service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-unplugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state active and task_state rescuing.
Aug 26 20:54:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Instance destroyed successfully.
Aug 26 20:54:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Attempting a stable device rescue
Aug 26 20:54:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73476) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Instance directory exists: not creating {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 20:54:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Creating image(s)
Aug 26 20:54:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "/opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "/opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "/opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.036s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "26615134102b2c41ba7f02cfb02ba31ed60a508e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "26615134102b2c41ba7f02cfb02ba31ed60a508e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e.part --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:53 user nova-compute[73476]: DEBUG nova.virt.images [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] ae644d6f-33f5-4d70-8279-73ec39c7da05 was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 20:54:53 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:54:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e.part /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e.part /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e.converted" returned: 0 in 0.442s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-a47204cb-e51a-4e52-9106-52b0618cd6e0 req-43ce59dd-7ce0-4aa3-ac52-f6b06f2222a6 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-unplugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a47204cb-e51a-4e52-9106-52b0618cd6e0 req-43ce59dd-7ce0-4aa3-ac52-f6b06f2222a6 service nova] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a47204cb-e51a-4e52-9106-52b0618cd6e0 req-43ce59dd-7ce0-4aa3-ac52-f6b06f2222a6 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a47204cb-e51a-4e52-9106-52b0618cd6e0 req-43ce59dd-7ce0-4aa3-ac52-f6b06f2222a6 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-a47204cb-e51a-4e52-9106-52b0618cd6e0 req-43ce59dd-7ce0-4aa3-ac52-f6b06f2222a6 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] No waiting events found dispatching network-vif-unplugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:54 user nova-compute[73476]: WARNING nova.compute.manager [req-a47204cb-e51a-4e52-9106-52b0618cd6e0 req-43ce59dd-7ce0-4aa3-ac52-f6b06f2222a6 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received unexpected event network-vif-unplugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 for instance with vm_state active and task_state reboot_started.
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "26615134102b2c41ba7f02cfb02ba31ed60a508e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.798s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "26615134102b2c41ba7f02cfb02ba31ed60a508e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "26615134102b2c41ba7f02cfb02ba31ed60a508e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-58850e8f-e6db-4bbb-8629-9c467e8f5cf9 req-7db79a29-638c-4ce6-9fab-3c4525d9a9a0 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-58850e8f-e6db-4bbb-8629-9c467e8f5cf9 req-7db79a29-638c-4ce6-9fab-3c4525d9a9a0 service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-58850e8f-e6db-4bbb-8629-9c467e8f5cf9 req-7db79a29-638c-4ce6-9fab-3c4525d9a9a0 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-58850e8f-e6db-4bbb-8629-9c467e8f5cf9 req-7db79a29-638c-4ce6-9fab-3c4525d9a9a0 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-58850e8f-e6db-4bbb-8629-9c467e8f5cf9 req-7db79a29-638c-4ce6-9fab-3c4525d9a9a0 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:54 user nova-compute[73476]: WARNING nova.compute.manager [req-58850e8f-e6db-4bbb-8629-9c467e8f5cf9 req-7db79a29-638c-4ce6-9fab-3c4525d9a9a0 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state active and task_state rescuing.
Aug 26 20:54:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Snapshot image upload complete
Aug 26 20:54:54 user nova-compute[73476]: INFO nova.compute.manager [None req-a3b44bee-68f8-4ada-b2ca-47fe56be6d81 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Took 6.10 seconds to snapshot the instance on the hypervisor.
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e,backing_fmt=raw /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e,backing_fmt=raw /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue" returned: 0 in 0.050s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "26615134102b2c41ba7f02cfb02ba31ed60a508e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'migration_context' on Instance uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.objects.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<8644e702-6fc8-4c84-a208-ef9a78cda0ee> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Start _get_guest_xml network_info=[{"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "vif_mac": "fa:16:3e:43:d5:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ae644d6f-33f5-4d70-8279-73ec39c7da05', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '70f3243b-d50b-4b98-b0e3-0fc359feab5c', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFrSDmag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8644e702-6fc8-4c84-a208-ef9a78cda0ee', 'attached_at': '', 'detached_at': '', 'volume_id': '769f3a13-ce9a-4343-aa19-4fd3d34a90fb', 'serial': '769f3a13-ce9a-4343-aa19-4fd3d34a90fb'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'resources' on Instance uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.objects.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<8644e702-6fc8-4c84-a208-ef9a78cda0ee> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'numa_topology' on Instance uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.objects.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<8644e702-6fc8-4c84-a208-ef9a78cda0ee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:54:54 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:54:54 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.objects.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<8644e702-6fc8-4c84-a208-ef9a78cda0ee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFrSDmag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:54:54 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:54:54 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:54:54 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dfc7c0-e9a7-4c40-84fe-b2d75f0e8d70]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BFrSDmag\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 20:54:54 user nova-compute[73476]: node.name = iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb
Aug 26 20:54:54 user nova-compute[73476]: node.tpgt = -1
Aug 26 20:54:54 user nova-compute[73476]: node.startup = automatic
Aug 26 20:54:54 user nova-compute[73476]: node.leading_login = No
Aug 26 20:54:54 user nova-compute[73476]: iface.iscsi_ifacename = default
Aug 26 20:54:54 user nova-compute[73476]: iface.net_ifacename = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.ipaddress = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.prefix_len = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.hwaddress = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.transport_name = tcp
Aug 26 20:54:54 user nova-compute[73476]: iface.initiatorname = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.state = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.vlan_id = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.vlan_priority = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.vlan_state = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.iface_num = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.mtu = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.port = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.bootproto = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.subnet_mask = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.gateway = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.dhcp_alt_client_id = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.dhcp_dns = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.dhcp_learn_iqn = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.dhcp_vendor_id_state = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.dhcp_vendor_id = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.dhcp_slp_da = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.fragmentation = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.gratuitous_arp = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.incoming_forwarding = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.tos_state = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.tos = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.ttl = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.delayed_ack = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.tcp_nagle = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.tcp_wsf_state = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.tcp_wsf = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.tcp_timer_scale = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.tcp_timestamp = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.redirect = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.def_task_mgmt_timeout = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.header_digest = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.data_digest = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.immediate_data = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.initial_r2t = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.data_seq_inorder = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.data_pdu_inorder = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.erl = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.max_receive_data_len = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.first_burst_len = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.max_outstanding_r2t = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.max_burst_len = 0
Aug 26 20:54:54 user nova-compute[73476]: iface.chap_auth = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.bidi_chap = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.strict_login_compliance = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.discovery_auth = <empty>
Aug 26 20:54:54 user nova-compute[73476]: iface.discovery_logout = <empty>
Aug 26 20:54:54 user nova-compute[73476]: node.discovery_address = <empty>
Aug 26 20:54:54 user nova-compute[73476]: node.discovery_port = 0
Aug 26 20:54:54 user nova-compute[73476]: node.discovery_type = static
Aug 26 20:54:54 user nova-compute[73476]: node.session.initial_cmdsn = 0
Aug 26 20:54:54 user nova-compute[73476]: node.session.initial_login_retry_max = 8
Aug 26 20:54:54 user nova-compute[73476]: node.session.xmit_thread_priority = -20
Aug 26 20:54:54 user nova-compute[73476]: node.session.cmds_max = 128
Aug 26 20:54:54 user nova-compute[73476]: node.session.queue_depth = 32
Aug 26 20:54:54 user nova-compute[73476]: node.session.nr_sessions = 1
Aug 26 20:54:54 user nova-compute[73476]: node.session.auth.authmethod = CHAP
Aug 26 20:54:54 user nova-compute[73476]: node.session.auth.username = BFrSDmag
Aug 26 20:54:54 user nova-compute[73476]: node.session.auth.password = ***
Aug 26 20:54:54 user nova-compute[73476]: node.session.auth.username_in = <empty>
Aug 26 20:54:54 user nova-compute[73476]: node.session.auth.password_in = <empty>
Aug 26 20:54:54 user nova-compute[73476]: node.session.auth.chap_algs = MD5
Aug 26 20:54:54 user nova-compute[73476]: node.session.timeo.replacement_timeout = 120
Aug 26 20:54:54 user nova-compute[73476]: node.session.err_timeo.abort_timeout = 15
Aug 26 20:54:54 user nova-compute[73476]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 20:54:54 user nova-compute[73476]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 20:54:54 user nova-compute[73476]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.FastAbort = Yes
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.InitialR2T = No
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.ImmediateData = Yes
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.MaxConnections = 1
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 20:54:54 user nova-compute[73476]: node.session.iscsi.ERL = 0
Aug 26 20:54:54 user nova-compute[73476]: node.session.scan = manual
Aug 26 20:54:54 user nova-compute[73476]: node.session.reopen_max = 0
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].address = 172.16.0.220
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].port = 3260
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].startup = manual
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].tcp.window_size = 524288
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].tcp.type_of_service = 0
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].timeo.logout_timeout = 15
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].timeo.login_timeout = 15
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].timeo.auth_timeout = 45
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].iscsi.DataDigest = None
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].iscsi.IFMarker = No
Aug 26 20:54:54 user nova-compute[73476]: node.conn[0].iscsi.OFMarker = No
Aug 26 20:54:54 user nova-compute[73476]: # END RECORD
Aug 26 20:54:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6609e1-c6e8-49bf-9ee6-82ba4f22b285]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.070s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b723de-18d3-47d9-b2fa-46c39f1a7b66]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFrSDmag {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Instance shutdown successfully.
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFrSDmag" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[766928f5-6af8-49a6-b2f4-7e680bbf2783]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BFrSDmag'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47d499-95ac-4d97-bbcf-c63195075836]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[22124956-46aa-4dbc-acf2-607ab3d0854d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:54:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:54:54 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:54:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.223s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] HCTL ('33', '0', '0', 0) found on session 33 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:54:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfefce7-7fbd-4c9e-a7f7-3dbe5923dc8b]: (4, ('0 0 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Searching for a device in session 33 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFrSDmag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.253s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] <== connect_volume: return (255ms) {'type': 'block', 'scsi_wwn': '23035666633333231', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035666633333231', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-329720098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-329720098',id=29,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-bjxqghlw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:53:34Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=8644e702-6fc8-4c84-a208-ef9a78cda0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "vif_mac": "fa:16:3e:43:d5:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "vif_mac": "fa:16:3e:43:d5:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=9b7fc934-fd11-4397-92d8-3aa023d9e63b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7fc934-fd') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.objects.instance [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'pci_devices' on Instance uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.objects.base [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Object Instance<8644e702-6fc8-4c84-a208-ef9a78cda0ee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:54:55 user nova-compute[73476]:   <uuid>8644e702-6fc8-4c84-a208-ef9a78cda0ee</uuid>
Aug 26 20:54:55 user nova-compute[73476]:   <name>instance-0000001d</name>
Aug 26 20:54:55 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:54:55 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:54:55 user nova-compute[73476]:   <metadata>
Aug 26 20:54:55 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:54:55 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:54:55 user nova-compute[73476]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-329720098</nova:name>
Aug 26 20:54:55 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:54:54</nova:creationTime>
Aug 26 20:54:55 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:54:55 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:54:55 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:54:55 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:54:55 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:54:55 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:54:55 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:54:55 user nova-compute[73476]:       <nova:owner>
Aug 26 20:54:55 user nova-compute[73476]:         <nova:user uuid="5ed2a98f37294fd381fd1dfe7c5c0751">tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member</nova:user>
Aug 26 20:54:55 user nova-compute[73476]:         <nova:project uuid="679727d63ba04ad48740d1b967be5a61">tempest-ServerBootFromVolumeStableRescueTest-735166680</nova:project>
Aug 26 20:54:55 user nova-compute[73476]:       </nova:owner>
Aug 26 20:54:55 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:54:55 user nova-compute[73476]:       <nova:ports>
Aug 26 20:54:55 user nova-compute[73476]:         <nova:port uuid="9b7fc934-fd11-4397-92d8-3aa023d9e63b">
Aug 26 20:54:55 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 20:54:55 user nova-compute[73476]:         </nova:port>
Aug 26 20:54:55 user nova-compute[73476]:       </nova:ports>
Aug 26 20:54:55 user nova-compute[73476]:     </nova:instance>
Aug 26 20:54:55 user nova-compute[73476]:   </metadata>
Aug 26 20:54:55 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:54:55 user nova-compute[73476]:     <system>
Aug 26 20:54:55 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:54:55 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:54:55 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:54:55 user nova-compute[73476]:       <entry name="serial">8644e702-6fc8-4c84-a208-ef9a78cda0ee</entry>
Aug 26 20:54:55 user nova-compute[73476]:       <entry name="uuid">8644e702-6fc8-4c84-a208-ef9a78cda0ee</entry>
Aug 26 20:54:55 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:54:55 user nova-compute[73476]:     </system>
Aug 26 20:54:55 user nova-compute[73476]:   </sysinfo>
Aug 26 20:54:55 user nova-compute[73476]:   <os>
Aug 26 20:54:55 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:54:55 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:54:55 user nova-compute[73476]:   </os>
Aug 26 20:54:55 user nova-compute[73476]:   <features>
Aug 26 20:54:55 user nova-compute[73476]:     <acpi/>
Aug 26 20:54:55 user nova-compute[73476]:     <apic/>
Aug 26 20:54:55 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:54:55 user nova-compute[73476]:   </features>
Aug 26 20:54:55 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:54:55 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:54:55 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:54:55 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:54:55 user nova-compute[73476]:   </clock>
Aug 26 20:54:55 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:54:55 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:54:55 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:54:55 user nova-compute[73476]:   </cpu>
Aug 26 20:54:55 user nova-compute[73476]:   <devices>
Aug 26 20:54:55 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:54:55 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:54:55 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 20:54:55 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:54:55 user nova-compute[73476]:       <serial>769f3a13-ce9a-4343-aa19-4fd3d34a90fb</serial>
Aug 26 20:54:55 user nova-compute[73476]:     </disk>
Aug 26 20:54:55 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:54:55 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:54:55 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue"/>
Aug 26 20:54:55 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:54:55 user nova-compute[73476]:       <boot order="1"/>
Aug 26 20:54:55 user nova-compute[73476]:     </disk>
Aug 26 20:54:55 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:54:55 user nova-compute[73476]:       <mac address="fa:16:3e:43:d5:a5"/>
Aug 26 20:54:55 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:54:55 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:54:55 user nova-compute[73476]:       <target dev="tap9b7fc934-fd"/>
Aug 26 20:54:55 user nova-compute[73476]:     </interface>
Aug 26 20:54:55 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:54:55 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/console.log" append="off"/>
Aug 26 20:54:55 user nova-compute[73476]:     </serial>
Aug 26 20:54:55 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:54:55 user nova-compute[73476]:     <video>
Aug 26 20:54:55 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:54:55 user nova-compute[73476]:     </video>
Aug 26 20:54:55 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:54:55 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:54:55 user nova-compute[73476]:     </rng>
Aug 26 20:54:55 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:54:55 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:54:55 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:54:55 user nova-compute[73476]:     </memballoon>
Aug 26 20:54:55 user nova-compute[73476]:   </devices>
Aug 26 20:54:55 user nova-compute[73476]: </domain>
Aug 26 20:54:55 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:54:55 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Instance destroyed successfully.
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] No VIF found with MAC fa:16:3e:43:d5:a5, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:56 user nova-compute[73476]: DEBUG nova.compute.manager [req-8838ba73-ff1f-4728-afc7-c231bdb77d83 req-79ec167d-2c95-4184-901a-02dae36cd84d service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8838ba73-ff1f-4728-afc7-c231bdb77d83 req-79ec167d-2c95-4184-901a-02dae36cd84d service nova] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8838ba73-ff1f-4728-afc7-c231bdb77d83 req-79ec167d-2c95-4184-901a-02dae36cd84d service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8838ba73-ff1f-4728-afc7-c231bdb77d83 req-79ec167d-2c95-4184-901a-02dae36cd84d service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:56 user nova-compute[73476]: DEBUG nova.compute.manager [req-8838ba73-ff1f-4728-afc7-c231bdb77d83 req-79ec167d-2c95-4184-901a-02dae36cd84d service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] No waiting events found dispatching network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:56 user nova-compute[73476]: WARNING nova.compute.manager [req-8838ba73-ff1f-4728-afc7-c231bdb77d83 req-79ec167d-2c95-4184-901a-02dae36cd84d service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received unexpected event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 for instance with vm_state active and task_state reboot_started.
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-8a96c4b7-d987-4c7f-86be-54aa4e4d730e req-ad92110c-b490-4cdc-a524-d9d2c93505e3 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8a96c4b7-d987-4c7f-86be-54aa4e4d730e req-ad92110c-b490-4cdc-a524-d9d2c93505e3 service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8a96c4b7-d987-4c7f-86be-54aa4e4d730e req-ad92110c-b490-4cdc-a524-d9d2c93505e3 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8a96c4b7-d987-4c7f-86be-54aa4e4d730e req-ad92110c-b490-4cdc-a524-d9d2c93505e3 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-8a96c4b7-d987-4c7f-86be-54aa4e4d730e req-ad92110c-b490-4cdc-a524-d9d2c93505e3 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:57 user nova-compute[73476]: WARNING nova.compute.manager [req-8a96c4b7-d987-4c7f-86be-54aa4e4d730e req-ad92110c-b490-4cdc-a524-d9d2c93505e3 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state active and task_state rescuing.
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:58 user nova-compute[73476]: INFO nova.compute.manager [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Terminating instance
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] No waiting events found dispatching network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:58 user nova-compute[73476]: WARNING nova.compute.manager [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received unexpected event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 for instance with vm_state active and task_state reboot_started.
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] No waiting events found dispatching network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:58 user nova-compute[73476]: WARNING nova.compute.manager [req-ad3d1458-281d-4962-bff5-006b43ce6d05 req-9f26c500-db2b-41aa-8b40-c7f1a971ec64 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received unexpected event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 for instance with vm_state active and task_state reboot_started.
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Instance destroyed successfully.
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.objects.instance [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lazy-loading 'resources' on Instance uuid ef7f0adb-9324-43ac-b3b7-593900b1576f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1984423643',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1984423643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1984423',id=25,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9HMVD9jJy2zn+zWRa4Kr1qjaVcsd1nqX44msMW1sKlO4fHuF4Pg1cNJrtaAHxaZyif5l2WJ++i7I0L3rv+MknmwIgUcy+DTexJxIJsOM4FSGKsJXnitIp2TH3wJ8lYMA==',key_name='tempest-keypair-1698214889',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09c34d572b644f28af2154f4a90b292f',ramdisk_id='',reservation_id='r-wl07ltd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-219026822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e52fb5b6f63484e9774df9788000210',uuid=ef7f0adb-9324-43ac-b3b7-593900b1576f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Converting VIF {"id": "e016713d-e390-4c42-b097-4907edc7ba6e", "address": "fa:16:3e:7a:f3:2f", "network": {"id": "52a0d985-b54c-47d2-8403-0284c7d75462", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-287226681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09c34d572b644f28af2154f4a90b292f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape016713d-e3", "ovs_interfaceid": "e016713d-e390-4c42-b097-4907edc7ba6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:f3:2f,bridge_name='br-int',has_traffic_filtering=True,id=e016713d-e390-4c42-b097-4907edc7ba6e,network=Network(52a0d985-b54c-47d2-8403-0284c7d75462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape016713d-e3') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG os_vif [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:f3:2f,bridge_name='br-int',has_traffic_filtering=True,id=e016713d-e390-4c42-b097-4907edc7ba6e,network=Network(52a0d985-b54c-47d2-8403-0284c7d75462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape016713d-e3') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape016713d-e3, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:54:58 user nova-compute[73476]: INFO os_vif [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:f3:2f,bridge_name='br-int',has_traffic_filtering=True,id=e016713d-e390-4c42-b097-4907edc7ba6e,network=Network(52a0d985-b54c-47d2-8403-0284c7d75462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape016713d-e3')
Aug 26 20:54:58 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Deleting instance files /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f_del
Aug 26 20:54:58 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Deletion of /opt/stack/data/nova/instances/ef7f0adb-9324-43ac-b3b7-593900b1576f_del complete
Aug 26 20:54:58 user nova-compute[73476]: INFO nova.compute.manager [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 20:54:58 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:54:58 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:54:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-7f6c15fb-037d-440b-be9d-739efb319003 req-2e985038-17b0-47f2-b1cd-8846d539a6d5 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:54:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7f6c15fb-037d-440b-be9d-739efb319003 req-2e985038-17b0-47f2-b1cd-8846d539a6d5 service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:54:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7f6c15fb-037d-440b-be9d-739efb319003 req-2e985038-17b0-47f2-b1cd-8846d539a6d5 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:54:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7f6c15fb-037d-440b-be9d-739efb319003 req-2e985038-17b0-47f2-b1cd-8846d539a6d5 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:54:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-7f6c15fb-037d-440b-be9d-739efb319003 req-2e985038-17b0-47f2-b1cd-8846d539a6d5 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:54:59 user nova-compute[73476]: WARNING nova.compute.manager [req-7f6c15fb-037d-440b-be9d-739efb319003 req-2e985038-17b0-47f2-b1cd-8846d539a6d5 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state active and task_state rescuing.
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Took 1.11 seconds to deallocate network for instance.
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083300.2043216, d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] VM Resumed (Lifecycle Event)
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-70615c91-10f8-4706-a24b-66165e2a6907 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Instance running successfully.
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Instance soft rebooted successfully.
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083300.204685, d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] VM Started (Lifecycle Event)
Aug 26 20:55:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e7108a26-f064-49eb-af2b-fbd7604aa9e0 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.636s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for 8644e702-6fc8-4c84-a208-ef9a78cda0ee due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083300.20683, 8644e702-6fc8-4c84-a208-ef9a78cda0ee => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] VM Resumed (Lifecycle Event)
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083300.212159, 8644e702-6fc8-4c84-a208-ef9a78cda0ee => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] VM Started (Lifecycle Event)
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received event network-vif-unplugged-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] No waiting events found dispatching network-vif-unplugged-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:00 user nova-compute[73476]: WARNING nova.compute.manager [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received unexpected event network-vif-unplugged-e016713d-e390-4c42-b097-4907edc7ba6e for instance with vm_state deleted and task_state None.
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received event network-vif-plugged-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] Acquiring lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] No waiting events found dispatching network-vif-plugged-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:00 user nova-compute[73476]: WARNING nova.compute.manager [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received unexpected event network-vif-plugged-e016713d-e390-4c42-b097-4907edc7ba6e for instance with vm_state deleted and task_state None.
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-72e814b3-e3f9-4570-b034-88fa24db2ad9 req-5239fbb9-b5ad-45ef-9106-d61aa7943530 service nova] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Received event network-vif-deleted-e016713d-e390-4c42-b097-4907edc7ba6e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083285.0407221, 08d4a50e-f447-43b0-9b57-9c73a9b11d3e => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] VM Stopped (Lifecycle Event)
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8d50333e-e453-46e8-b3de-d043facbe0fc None None] [instance: 08d4a50e-f447-43b0-9b57-9c73a9b11d3e] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.564s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:00 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Deleted allocations for instance ef7f0adb-9324-43ac-b3b7-593900b1576f
Aug 26 20:55:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-27d1c80e-0be0-4a80-97bb-e911b1a954a8 tempest-TestServerVolumeAttachScenarioOldVersion-219026822 tempest-TestServerVolumeAttachScenarioOldVersion-219026822-project-member] Lock "ef7f0adb-9324-43ac-b3b7-593900b1576f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.789s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-7b8458f6-accf-4251-8370-6fc7281fd938 req-73af1381-53de-4dc6-b25e-940e5225ef27 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received event network-changed-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-7b8458f6-accf-4251-8370-6fc7281fd938 req-73af1381-53de-4dc6-b25e-940e5225ef27 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Refreshing instance network info cache due to event network-changed-b6751288-099f-4014-9eaa-40b28f0baec4. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7b8458f6-accf-4251-8370-6fc7281fd938 req-73af1381-53de-4dc6-b25e-940e5225ef27 service nova] Acquiring lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7b8458f6-accf-4251-8370-6fc7281fd938 req-73af1381-53de-4dc6-b25e-940e5225ef27 service nova] Acquired lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG nova.network.neutron [req-7b8458f6-accf-4251-8370-6fc7281fd938 req-73af1381-53de-4dc6-b25e-940e5225ef27 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Refreshing network info cache for port b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG nova.network.neutron [req-7b8458f6-accf-4251-8370-6fc7281fd938 req-73af1381-53de-4dc6-b25e-940e5225ef27 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Updated VIF entry in instance network info cache for port b6751288-099f-4014-9eaa-40b28f0baec4. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG nova.network.neutron [req-7b8458f6-accf-4251-8370-6fc7281fd938 req-73af1381-53de-4dc6-b25e-940e5225ef27 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Updating instance_info_cache with network_info: [{"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7b8458f6-accf-4251-8370-6fc7281fd938 req-73af1381-53de-4dc6-b25e-940e5225ef27 service nova] Releasing lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083298.8877368, ef7f0adb-9324-43ac-b3b7-593900b1576f => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:13 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] VM Stopped (Lifecycle Event)
Aug 26 20:55:13 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b65b6f43-43be-4bde-8731-f5ed333091cb None None] [instance: ef7f0adb-9324-43ac-b3b7-593900b1576f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Stashing vm_state: active {{(pid=73476) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 20:55:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:14 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:55:14 user nova-compute[73476]: INFO nova.compute.claims [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Claim successful on node user
Aug 26 20:55:14 user nova-compute[73476]: INFO nova.compute.resource_tracker [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updating resource usage from migration bf73e749-6959-4731-b116-379407616db4
Aug 26 20:55:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-f8670d48-85c0-4fe2-8408-7c0d858d9ab5 req-98cd43ec-4565-4a54-8556-af58d2a0ec7b service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received event network-changed-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-f8670d48-85c0-4fe2-8408-7c0d858d9ab5 req-98cd43ec-4565-4a54-8556-af58d2a0ec7b service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Refreshing instance network info cache due to event network-changed-a830ab77-92de-4d26-9371-0c133f6d2bf1. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:55:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f8670d48-85c0-4fe2-8408-7c0d858d9ab5 req-98cd43ec-4565-4a54-8556-af58d2a0ec7b service nova] Acquiring lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f8670d48-85c0-4fe2-8408-7c0d858d9ab5 req-98cd43ec-4565-4a54-8556-af58d2a0ec7b service nova] Acquired lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:15 user nova-compute[73476]: DEBUG nova.network.neutron [req-f8670d48-85c0-4fe2-8408-7c0d858d9ab5 req-98cd43ec-4565-4a54-8556-af58d2a0ec7b service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Refreshing network info cache for port a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:55:15 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:55:15 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:55:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.571s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:15 user nova-compute[73476]: INFO nova.compute.manager [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Migrating
Aug 26 20:55:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:16 user nova-compute[73476]: DEBUG nova.network.neutron [req-f8670d48-85c0-4fe2-8408-7c0d858d9ab5 req-98cd43ec-4565-4a54-8556-af58d2a0ec7b service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updated VIF entry in instance network info cache for port a830ab77-92de-4d26-9371-0c133f6d2bf1. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:55:16 user nova-compute[73476]: DEBUG nova.network.neutron [req-f8670d48-85c0-4fe2-8408-7c0d858d9ab5 req-98cd43ec-4565-4a54-8556-af58d2a0ec7b service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updating instance_info_cache with network_info: [{"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f8670d48-85c0-4fe2-8408-7c0d858d9ab5 req-98cd43ec-4565-4a54-8556-af58d2a0ec7b service nova] Releasing lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquired lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:16 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:55:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:16 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updating instance_info_cache with network_info: [{"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Releasing lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Starting migrate_disk_and_power_off {{(pid=73476) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-df88c444-52ba-4078-824b-099812a49126 req-b351ee0b-1698-4ac3-983e-5fdbead9e368 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received event network-vif-unplugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df88c444-52ba-4078-824b-099812a49126 req-b351ee0b-1698-4ac3-983e-5fdbead9e368 service nova] Acquiring lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df88c444-52ba-4078-824b-099812a49126 req-b351ee0b-1698-4ac3-983e-5fdbead9e368 service nova] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-df88c444-52ba-4078-824b-099812a49126 req-b351ee0b-1698-4ac3-983e-5fdbead9e368 service nova] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-df88c444-52ba-4078-824b-099812a49126 req-b351ee0b-1698-4ac3-983e-5fdbead9e368 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] No waiting events found dispatching network-vif-unplugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:17 user nova-compute[73476]: WARNING nova.compute.manager [req-df88c444-52ba-4078-824b-099812a49126 req-b351ee0b-1698-4ac3-983e-5fdbead9e368 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received unexpected event network-vif-unplugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 for instance with vm_state active and task_state resize_migrating.
Aug 26 20:55:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:17 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Instance destroyed successfully.
Aug 26 20:55:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-275903418',display_name='tempest-ServerActionsTestOtherA-server-275903418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-275903418',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrUMTyGNKdGpzDsrysQPohyAkRqtJhi3sdBZorTU8L/A2dHf0ht3Zah6gdCoAeVQTlLTdvxBfzTJPbHDiEF3xFnMtXTZ/YbW5aEqOqGzGXK2CkdK6c5/YxdHT2BmY6wkQ==',key_name='tempest-keypair-2137585327',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-mljsme95',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:55:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=aae763e2-8571-4c3f-91e3-4cc501b3d335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-481728464-network", "vif_mac": "fa:16:3e:fe:cc:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-481728464-network", "vif_mac": "fa:16:3e:fe:cc:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG os_vif [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa830ab77-92, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:17 user nova-compute[73476]: INFO os_vif [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92')
Aug 26 20:55:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrEXBqAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:55:17 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:55:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[82373b5d-0aa2-4d38-b6e9-3a8d04c654a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5867979-403a-4b9e-8d6d-b186aa9ea25c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:17 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:55:17 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:17 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258ce1a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011'): ({'sdd'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Removing single pathed devices sdd {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2910476f-9a53-41b1-b03e-1eb8ad206d37]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa08889-e2b8-4a1f-866e-21f808ee0933]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Flushing IO for device /dev/sdd {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3612c61c-d704-4e12-8547-3aca3d5973f2]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[263c4268-d8f3-4448-9d53-2c8e1f735bfb]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c75058-b1a7-4792-a7ca-b63be64eca1f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09facf1-7c2d-44c4-90bf-c669a0087f33]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011, portal: 172.16.0.220,3260]
Aug 26 20:55:18 user nova-compute[73476]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011, portal: 172.16.0.220,3260] successful.
Aug 26 20:55:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[973d0653-298b-4330-a3a9-f899f4919397]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== disconnect_volume: return (348ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:55:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Port a830ab77-92de-4d26-9371-0c133f6d2bf1 binding to destination host user is already ACTIVE {{(pid=73476) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-2c461865-95b2-41a2-9306-096fa1ada06d req-e98eed27-f926-49c1-9e88-711749ea6769 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received event network-vif-plugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2c461865-95b2-41a2-9306-096fa1ada06d req-e98eed27-f926-49c1-9e88-711749ea6769 service nova] Acquiring lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2c461865-95b2-41a2-9306-096fa1ada06d req-e98eed27-f926-49c1-9e88-711749ea6769 service nova] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2c461865-95b2-41a2-9306-096fa1ada06d req-e98eed27-f926-49c1-9e88-711749ea6769 service nova] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-2c461865-95b2-41a2-9306-096fa1ada06d req-e98eed27-f926-49c1-9e88-711749ea6769 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] No waiting events found dispatching network-vif-plugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:19 user nova-compute[73476]: WARNING nova.compute.manager [req-2c461865-95b2-41a2-9306-096fa1ada06d req-e98eed27-f926-49c1-9e88-711749ea6769 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received unexpected event network-vif-plugged-a830ab77-92de-4d26-9371-0c133f6d2bf1 for instance with vm_state active and task_state resize_migrated.
Aug 26 20:55:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquired lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updating instance_info_cache with network_info: [{"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Releasing lock "refresh_cache-aae763e2-8571-4c3f-91e3-4cc501b3d335" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG os_brick.utils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1bef35-4c3f-410e-90c6-af5ba2dfe1bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfa48f5-ce25-4c40-a75c-ccf877ff58fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3725ebff-56b1-499c-a01d-bb0fb9ef9982]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d45d63-da9d-4c0d-9884-1e35bae58e93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:55:20 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:55:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5ca43a-ab07-49dd-bd6e-18c674534efe]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG os_brick.utils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:55:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-e8521437-31d9-4ea0-b361-8a16aec7a9a6 req-aa6e191a-bebd-41c4-a43f-4ba0022cd39d service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-e8521437-31d9-4ea0-b361-8a16aec7a9a6 req-aa6e191a-bebd-41c4-a43f-4ba0022cd39d service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing instance network info cache due to event network-changed-d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e8521437-31d9-4ea0-b361-8a16aec7a9a6 req-aa6e191a-bebd-41c4-a43f-4ba0022cd39d service nova] Acquiring lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e8521437-31d9-4ea0-b361-8a16aec7a9a6 req-aa6e191a-bebd-41c4-a43f-4ba0022cd39d service nova] Acquired lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG nova.network.neutron [req-e8521437-31d9-4ea0-b361-8a16aec7a9a6 req-aa6e191a-bebd-41c4-a43f-4ba0022cd39d service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Refreshing network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:27 user nova-compute[73476]: INFO nova.compute.manager [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Terminating instance
Aug 26 20:55:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-49fa2abb-79d3-4103-91ef-4e5eaf46a3dc req-c6bf23e9-2e45-4cc8-9079-6064c91db258 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-unplugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-49fa2abb-79d3-4103-91ef-4e5eaf46a3dc req-c6bf23e9-2e45-4cc8-9079-6064c91db258 service nova] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-49fa2abb-79d3-4103-91ef-4e5eaf46a3dc req-c6bf23e9-2e45-4cc8-9079-6064c91db258 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-49fa2abb-79d3-4103-91ef-4e5eaf46a3dc req-c6bf23e9-2e45-4cc8-9079-6064c91db258 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-49fa2abb-79d3-4103-91ef-4e5eaf46a3dc req-c6bf23e9-2e45-4cc8-9079-6064c91db258 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] No waiting events found dispatching network-vif-unplugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-49fa2abb-79d3-4103-91ef-4e5eaf46a3dc req-c6bf23e9-2e45-4cc8-9079-6064c91db258 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-unplugged-d1598316-d7b5-4f58-947f-bee401d27b41 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.network.neutron [req-e8521437-31d9-4ea0-b361-8a16aec7a9a6 req-aa6e191a-bebd-41c4-a43f-4ba0022cd39d service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updated VIF entry in instance network info cache for port d1598316-d7b5-4f58-947f-bee401d27b41. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.network.neutron [req-e8521437-31d9-4ea0-b361-8a16aec7a9a6 req-aa6e191a-bebd-41c4-a43f-4ba0022cd39d service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating instance_info_cache with network_info: [{"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e8521437-31d9-4ea0-b361-8a16aec7a9a6 req-aa6e191a-bebd-41c4-a43f-4ba0022cd39d service nova] Releasing lock "refresh_cache-6de9ed93-5d15-49cc-82fd-f4822fae54af" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:28 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Instance destroyed successfully.
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.objects.instance [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lazy-loading 'resources' on Instance uuid 6de9ed93-5d15-49cc-82fd-f4822fae54af {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1052320475',display_name='tempest-TestShelveInstance-server-1052320475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1052320475',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9cneXgwenfoYbuZN8VdIjbq4P2M0guz+16jiyOigb8AgEqLxTm4bpfx8QdV/+zvdA3MHfUK2i4KW0nXA6NtKFaCQ0eZGPQQtLl65fp1vrWGC50VSojhGKAJ/OwKPFgOA==',key_name='tempest-TestShelveInstance-1851856693',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:54:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6d618e1c9c4d42bb6572b5dcc2596a',ramdisk_id='',reservation_id='r-h4v8vnt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1238211530',owner_user_name='tempest-TestShelveInstance-1238211530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:54:03Z,user_data=None,user_id='c28d237e1730497f9b425a1b9bb1aaf5',uuid=6de9ed93-5d15-49cc-82fd-f4822fae54af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converting VIF {"id": "d1598316-d7b5-4f58-947f-bee401d27b41", "address": "fa:16:3e:b7:fa:1f", "network": {"id": "a7ace997-1080-4b55-9a02-c6e3b6abeb9c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1981698670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6d618e1c9c4d42bb6572b5dcc2596a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1598316-d7", "ovs_interfaceid": "d1598316-d7b5-4f58-947f-bee401d27b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_vif [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1598316-d7, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:55:28 user nova-compute[73476]: INFO os_vif [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fa:1f,bridge_name='br-int',has_traffic_filtering=True,id=d1598316-d7b5-4f58-947f-bee401d27b41,network=Network(a7ace997-1080-4b55-9a02-c6e3b6abeb9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1598316-d7')
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HYQgzvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:55:28 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[07887692-e4ae-49fe-9eb0-cd1983a894fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[74444ef5-3912-40bc-b004-e8e98e18e214]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:28 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:28 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:28 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:55:28 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:28 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:28 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:28 user nova-compute[73476]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b (non-flash)
Aug 26 20:55:28 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d02acd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b'): ({'sdf'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Removing single pathed devices sdf {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c930c0a-900f-47f5-932e-72b91e056e35]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[53004b93-e856-40fe-a929-4b0db373f67f]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Flushing IO for device /dev/sdf {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8e6c4a-9b27-404b-8b52-0b4cc49563f4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[312870ff-923f-47a2-b822-c8027f55dc79]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] SCSI volumes sdf have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_34b0a2db', '/dev/disk/by-id/scsi-1SCST_BIO34b0a2db-012c574ef49319de', '/dev/disk/by-id/scsi-23031326335373465') {{(pid=84820) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 20:55:28 user nova-compute[73476]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_34b0a2db
Aug 26 20:55:28 user nova-compute[73476]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO34b0a2db-012c574ef49319de
Aug 26 20:55:28 user nova-compute[73476]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23031326335373465
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[da49b77c-f3b2-47c6-b3b2-048e8ac92091]: (4, None) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f0dd48-06ea-4145-96f0-233c87fd83c5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00454ff-2e5f-4680-8fbc-7e9deed796ae]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260]
Aug 26 20:55:28 user nova-compute[73476]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b, portal: 172.16.0.220,3260] successful.
Aug 26 20:55:28 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdd46c1-c082-43fe-8b6c-88c965bf41ab]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] <== disconnect_volume: return (304ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:55:28 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:55:28 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Deleting instance files /opt/stack/data/nova/instances/6de9ed93-5d15-49cc-82fd-f4822fae54af_del
Aug 26 20:55:28 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Deletion of /opt/stack/data/nova/instances/6de9ed93-5d15-49cc-82fd-f4822fae54af_del complete
Aug 26 20:55:29 user nova-compute[73476]: INFO nova.compute.manager [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 20:55:29 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:55:29 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:55:29 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:55:29 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:29 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Took 0.53 seconds to deallocate network for instance.
Aug 26 20:55:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-367d3d91-7abb-4c3a-9e33-91c94b33240c req-4109a161-ebbf-436f-ac52-ca40a96b2d38 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-367d3d91-7abb-4c3a-9e33-91c94b33240c req-4109a161-ebbf-436f-ac52-ca40a96b2d38 service nova] Acquiring lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-367d3d91-7abb-4c3a-9e33-91c94b33240c req-4109a161-ebbf-436f-ac52-ca40a96b2d38 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-367d3d91-7abb-4c3a-9e33-91c94b33240c req-4109a161-ebbf-436f-ac52-ca40a96b2d38 service nova] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-367d3d91-7abb-4c3a-9e33-91c94b33240c req-4109a161-ebbf-436f-ac52-ca40a96b2d38 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] No waiting events found dispatching network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:30 user nova-compute[73476]: WARNING nova.compute.manager [req-367d3d91-7abb-4c3a-9e33-91c94b33240c req-4109a161-ebbf-436f-ac52-ca40a96b2d38 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received unexpected event network-vif-plugged-d1598316-d7b5-4f58-947f-bee401d27b41 for instance with vm_state active and task_state deleting.
Aug 26 20:55:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-367d3d91-7abb-4c3a-9e33-91c94b33240c req-4109a161-ebbf-436f-ac52-ca40a96b2d38 service nova] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Received event network-vif-deleted-d1598316-d7b5-4f58-947f-bee401d27b41 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:30 user nova-compute[73476]: INFO nova.compute.manager [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 20:55:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Deleting volume: 3538703d-e8cc-4ed6-a7ea-a4377639b36b {{(pid=73476) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 20:55:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.volume.cinder [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Update attachment failed for attachment b6cc18e0-d969-42d2-969d-95c4b4f9f6a3. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b was not found.).). (HTTP 500) (Request-ID: req-f5290d19-685b-4c83-a31a-98bc6061b5a0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b was not found.).). (HTTP 500) (Request-ID: req-f5290d19-685b-4c83-a31a-98bc6061b5a0)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b was not found.).). (HTTP 500) (Request-ID: req-f5290d19-685b-4c83-a31a-98bc6061b5a0)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Traceback (most recent call last):
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/nova/nova/compute/manager.py", line 10766, in _error_out_instance_on_exception
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     yield
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/nova/nova/compute/manager.py", line 6298, in _finish_resize_helper
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     network_info = self._finish_resize(context, instance, migration,
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/nova/nova/compute/manager.py", line 6202, in _finish_resize
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     self._update_volume_attachments(context, instance, bdms)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/nova/nova/compute/manager.py", line 6132, in _update_volume_attachments
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     self.volume_api.attachment_update(
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     res = method(self, ctx, *args, **kwargs)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     with excutils.save_and_reraise_exception():
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     self.force_reraise()
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     raise self.value
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     return method.func(obj, *args, **kwargs)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     resp = self._update('/attachments/%s' % id, body)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     return self.request(url, method, **kwargs)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335]     raise exceptions.from_response(resp, body)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b was not found.).). (HTTP 500) (Request-ID: req-f5290d19-685b-4c83-a31a-98bc6061b5a0)
Aug 26 20:55:30 user nova-compute[73476]: ERROR nova.compute.manager [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] 
Aug 26 20:55:30 user nova-compute[73476]: INFO nova.compute.manager [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Aug 26 20:55:30 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:55:30 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:55:30 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Deleted allocation for migration bf73e749-6959-4731-b116-379407616db4
Aug 26 20:55:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:31 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Deleted allocations for instance 6de9ed93-5d15-49cc-82fd-f4822fae54af
Aug 26 20:55:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-61c7da9a-a66d-4060-a58d-1007be260216 tempest-TestShelveInstance-1238211530 tempest-TestShelveInstance-1238211530-project-member] Lock "6de9ed93-5d15-49cc-82fd-f4822fae54af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.261s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:31 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:55:31 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:55:31 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:31 user nova-compute[73476]: INFO nova.compute.manager [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Successfully reverted task state from resize_finish on failure for instance.
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server [None req-e5a5f841-a638-4fc2-b0ca-94a2c6552432 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b was not found.).). (HTTP 500) (Request-ID: req-f5290d19-685b-4c83-a31a-98bc6061b5a0)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6268, in finish_resize
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6265, in finish_resize
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6298, in _finish_resize_helper
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6202, in _finish_resize
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6132, in _update_volume_attachments
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:3538703d-e8cc-4ed6-a7ea-a4377639b36b was not found.).). (HTTP 500) (Request-ID: req-f5290d19-685b-4c83-a31a-98bc6061b5a0)
Aug 26 20:55:31 user nova-compute[73476]: ERROR oslo_messaging.rpc.server 
Aug 26 20:55:31 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:31 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:31 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:55:32 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083317.8746703, aae763e2-8571-4c3f-91e3-4cc501b3d335 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:32 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] VM Stopped (Lifecycle Event)
Aug 26 20:55:32 user nova-compute[73476]: DEBUG nova.compute.manager [None req-375cc7fa-a329-4e85-aa19-7dc90e97598a None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:32 user nova-compute[73476]: DEBUG nova.compute.manager [None req-375cc7fa-a329-4e85-aa19-7dc90e97598a None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: error, current task_state: None, current DB power_state: 1, VM power_state: 4 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:55:32 user nova-compute[73476]: INFO nova.compute.manager [None req-375cc7fa-a329-4e85-aa19-7dc90e97598a None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (4). Updating power_state in the DB to match the hypervisor.
Aug 26 20:55:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-28f5779e-1f84-4cf0-8888-c00a44063ec1 req-b8a6a778-c222-45fb-9a0f-1e3d70eeec41 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received event network-changed-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-28f5779e-1f84-4cf0-8888-c00a44063ec1 req-b8a6a778-c222-45fb-9a0f-1e3d70eeec41 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Refreshing instance network info cache due to event network-changed-2051ba09-6f5f-41b3-b088-5e4ef66c89bc. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:55:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-28f5779e-1f84-4cf0-8888-c00a44063ec1 req-b8a6a778-c222-45fb-9a0f-1e3d70eeec41 service nova] Acquiring lock "refresh_cache-762ffba7-912d-40d7-af19-667df1760dc6" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-28f5779e-1f84-4cf0-8888-c00a44063ec1 req-b8a6a778-c222-45fb-9a0f-1e3d70eeec41 service nova] Acquired lock "refresh_cache-762ffba7-912d-40d7-af19-667df1760dc6" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:33 user nova-compute[73476]: DEBUG nova.network.neutron [req-28f5779e-1f84-4cf0-8888-c00a44063ec1 req-b8a6a778-c222-45fb-9a0f-1e3d70eeec41 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Refreshing network info cache for port 2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:55:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:33 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:33 user nova-compute[73476]: DEBUG nova.network.neutron [req-28f5779e-1f84-4cf0-8888-c00a44063ec1 req-b8a6a778-c222-45fb-9a0f-1e3d70eeec41 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Updated VIF entry in instance network info cache for port 2051ba09-6f5f-41b3-b088-5e4ef66c89bc. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:55:33 user nova-compute[73476]: DEBUG nova.network.neutron [req-28f5779e-1f84-4cf0-8888-c00a44063ec1 req-b8a6a778-c222-45fb-9a0f-1e3d70eeec41 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Updating instance_info_cache with network_info: [{"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-28f5779e-1f84-4cf0-8888-c00a44063ec1 req-b8a6a778-c222-45fb-9a0f-1e3d70eeec41 service nova] Releasing lock "refresh_cache-762ffba7-912d-40d7-af19-667df1760dc6" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "a015ae4b-1bc1-4748-839f-7a380bd002d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:55:36 user nova-compute[73476]: INFO nova.compute.claims [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Claim successful on node user
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:55:36 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.policy [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd38f2a23de67450a825596c77fe9dbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166fe05519d74dd78e3228e47ef09e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:55:36 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Creating image(s)
Aug 26 20:55:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "/opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "/opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "/opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:36 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk 1073741824" returned: 0 in 0.051s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Cannot resize image /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Ensure instance console log exists: /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:37 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Successfully created port: f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'flavor' on Instance uuid 762ffba7-912d-40d7-af19-667df1760dc6 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:38 user nova-compute[73476]: INFO nova.compute.manager [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Attaching volume 3f620d47-4110-4800-a71f-da992095c680 to /dev/vdb
Aug 26 20:55:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG os_brick.utils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec43cb2e-6508-4de3-86b7-8911ff6951e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6fd00f-d602-494a-8bcb-95fd636bd441]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcbd62c-9d36-4e93-a522-07a901cdf898]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a42a8e-8692-44b1-994e-1e68a9c3ba13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:55:38 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[05abfb13-1833-4e0b-8851-f14a581d427b]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG os_brick.utils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Updating existing volume attachment record: 69f77ad5-9d97-40ea-b6b8-4ce928985156 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Successfully updated port: f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "refresh_cache-a015ae4b-1bc1-4748-839f-7a380bd002d9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquired lock "refresh_cache-a015ae4b-1bc1-4748-839f-7a380bd002d9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:38 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-f2c13193-7d32-45ed-b76b-90102e1e4367 req-fe879275-b709-432f-a8d3-64bc26d67e4e service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received event network-changed-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-f2c13193-7d32-45ed-b76b-90102e1e4367 req-fe879275-b709-432f-a8d3-64bc26d67e4e service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Refreshing instance network info cache due to event network-changed-f55361d2-5582-45c5-a7f0-d679b9a04ba8. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f2c13193-7d32-45ed-b76b-90102e1e4367 req-fe879275-b709-432f-a8d3-64bc26d67e4e service nova] Acquiring lock "refresh_cache-a015ae4b-1bc1-4748-839f-7a380bd002d9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Updating instance_info_cache with network_info: [{"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Releasing lock "refresh_cache-a015ae4b-1bc1-4748-839f-7a380bd002d9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Instance network_info: |[{"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f2c13193-7d32-45ed-b76b-90102e1e4367 req-fe879275-b709-432f-a8d3-64bc26d67e4e service nova] Acquired lock "refresh_cache-a015ae4b-1bc1-4748-839f-7a380bd002d9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.network.neutron [req-f2c13193-7d32-45ed-b76b-90102e1e4367 req-fe879275-b709-432f-a8d3-64bc26d67e4e service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Refreshing network info cache for port f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Start _get_guest_xml network_info=[{"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:55:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:55:39 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-43705332',display_name='tempest-VolumesActionsTest-instance-43705332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-43705332',id=34,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='166fe05519d74dd78e3228e47ef09e90',ramdisk_id='',reservation_id='r-8cmb3aik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-562295190',owner_user_name='tempest-VolumesActionsTest-562295190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:55:37Z,user_data=None,user_id='d38f2a23de67450a825596c77fe9dbf2',uuid=a015ae4b-1bc1-4748-839f-7a380bd002d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converting VIF {"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=f55361d2-5582-45c5-a7f0-d679b9a04ba8,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55361d2-55') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lazy-loading 'pci_devices' on Instance uuid a015ae4b-1bc1-4748-839f-7a380bd002d9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:55:39 user nova-compute[73476]:   <uuid>a015ae4b-1bc1-4748-839f-7a380bd002d9</uuid>
Aug 26 20:55:39 user nova-compute[73476]:   <name>instance-00000022</name>
Aug 26 20:55:39 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:55:39 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:55:39 user nova-compute[73476]:   <metadata>
Aug 26 20:55:39 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:55:39 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:55:39 user nova-compute[73476]:       <nova:name>tempest-VolumesActionsTest-instance-43705332</nova:name>
Aug 26 20:55:39 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:55:39</nova:creationTime>
Aug 26 20:55:39 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:55:39 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:55:39 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:55:39 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:55:39 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:55:39 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:55:39 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:55:39 user nova-compute[73476]:       <nova:owner>
Aug 26 20:55:39 user nova-compute[73476]:         <nova:user uuid="d38f2a23de67450a825596c77fe9dbf2">tempest-VolumesActionsTest-562295190-project-member</nova:user>
Aug 26 20:55:39 user nova-compute[73476]:         <nova:project uuid="166fe05519d74dd78e3228e47ef09e90">tempest-VolumesActionsTest-562295190</nova:project>
Aug 26 20:55:39 user nova-compute[73476]:       </nova:owner>
Aug 26 20:55:39 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:55:39 user nova-compute[73476]:       <nova:ports>
Aug 26 20:55:39 user nova-compute[73476]:         <nova:port uuid="f55361d2-5582-45c5-a7f0-d679b9a04ba8">
Aug 26 20:55:39 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 20:55:39 user nova-compute[73476]:         </nova:port>
Aug 26 20:55:39 user nova-compute[73476]:       </nova:ports>
Aug 26 20:55:39 user nova-compute[73476]:     </nova:instance>
Aug 26 20:55:39 user nova-compute[73476]:   </metadata>
Aug 26 20:55:39 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:55:39 user nova-compute[73476]:     <system>
Aug 26 20:55:39 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:55:39 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:55:39 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:55:39 user nova-compute[73476]:       <entry name="serial">a015ae4b-1bc1-4748-839f-7a380bd002d9</entry>
Aug 26 20:55:39 user nova-compute[73476]:       <entry name="uuid">a015ae4b-1bc1-4748-839f-7a380bd002d9</entry>
Aug 26 20:55:39 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:55:39 user nova-compute[73476]:     </system>
Aug 26 20:55:39 user nova-compute[73476]:   </sysinfo>
Aug 26 20:55:39 user nova-compute[73476]:   <os>
Aug 26 20:55:39 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:55:39 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:55:39 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:55:39 user nova-compute[73476]:   </os>
Aug 26 20:55:39 user nova-compute[73476]:   <features>
Aug 26 20:55:39 user nova-compute[73476]:     <acpi/>
Aug 26 20:55:39 user nova-compute[73476]:     <apic/>
Aug 26 20:55:39 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:55:39 user nova-compute[73476]:   </features>
Aug 26 20:55:39 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:55:39 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:55:39 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:55:39 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:55:39 user nova-compute[73476]:   </clock>
Aug 26 20:55:39 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:55:39 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:55:39 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:55:39 user nova-compute[73476]:   </cpu>
Aug 26 20:55:39 user nova-compute[73476]:   <devices>
Aug 26 20:55:39 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:55:39 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:55:39 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk"/>
Aug 26 20:55:39 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:55:39 user nova-compute[73476]:     </disk>
Aug 26 20:55:39 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:55:39 user nova-compute[73476]:       <mac address="fa:16:3e:8e:7d:8f"/>
Aug 26 20:55:39 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:55:39 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:55:39 user nova-compute[73476]:       <target dev="tapf55361d2-55"/>
Aug 26 20:55:39 user nova-compute[73476]:     </interface>
Aug 26 20:55:39 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:55:39 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/console.log" append="off"/>
Aug 26 20:55:39 user nova-compute[73476]:     </serial>
Aug 26 20:55:39 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:55:39 user nova-compute[73476]:     <video>
Aug 26 20:55:39 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:55:39 user nova-compute[73476]:     </video>
Aug 26 20:55:39 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:55:39 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:55:39 user nova-compute[73476]:     </rng>
Aug 26 20:55:39 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:55:39 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:55:39 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:55:39 user nova-compute[73476]:     </memballoon>
Aug 26 20:55:39 user nova-compute[73476]:   </devices>
Aug 26 20:55:39 user nova-compute[73476]: </domain>
Aug 26 20:55:39 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-43705332',display_name='tempest-VolumesActionsTest-instance-43705332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-43705332',id=34,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='166fe05519d74dd78e3228e47ef09e90',ramdisk_id='',reservation_id='r-8cmb3aik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-562295190',owner_user_name='tempest-VolumesActionsTest-562295190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:55:37Z,user_data=None,user_id='d38f2a23de67450a825596c77fe9dbf2',uuid=a015ae4b-1bc1-4748-839f-7a380bd002d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converting VIF {"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=f55361d2-5582-45c5-a7f0-d679b9a04ba8,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55361d2-55') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG os_vif [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=f55361d2-5582-45c5-a7f0-d679b9a04ba8,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55361d2-55') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf55361d2-55, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf55361d2-55, col_values=(('external_ids', {'iface-id': 'f55361d2-5582-45c5-a7f0-d679b9a04ba8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:7d:8f', 'vm-uuid': 'a015ae4b-1bc1-4748-839f-7a380bd002d9'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:39 user nova-compute[73476]: INFO os_vif [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=f55361d2-5582-45c5-a7f0-d679b9a04ba8,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55361d2-55')
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] No VIF found with MAC fa:16:3e:8e:7d:8f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.network.neutron [req-f2c13193-7d32-45ed-b76b-90102e1e4367 req-fe879275-b709-432f-a8d3-64bc26d67e4e service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Updated VIF entry in instance network info cache for port f55361d2-5582-45c5-a7f0-d679b9a04ba8. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG nova.network.neutron [req-f2c13193-7d32-45ed-b76b-90102e1e4367 req-fe879275-b709-432f-a8d3-64bc26d67e4e service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Updating instance_info_cache with network_info: [{"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f2c13193-7d32-45ed-b76b-90102e1e4367 req-fe879275-b709-432f-a8d3-64bc26d67e4e service nova] Releasing lock "refresh_cache-a015ae4b-1bc1-4748-839f-7a380bd002d9" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:40 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:55:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-c4a0dfa4-525b-4c50-899d-aaa0b5ed56ff req-465bc3ee-370c-4bb6-a3b7-c98f83787bdb service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c4a0dfa4-525b-4c50-899d-aaa0b5ed56ff req-465bc3ee-370c-4bb6-a3b7-c98f83787bdb service nova] Acquiring lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c4a0dfa4-525b-4c50-899d-aaa0b5ed56ff req-465bc3ee-370c-4bb6-a3b7-c98f83787bdb service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c4a0dfa4-525b-4c50-899d-aaa0b5ed56ff req-465bc3ee-370c-4bb6-a3b7-c98f83787bdb service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-c4a0dfa4-525b-4c50-899d-aaa0b5ed56ff req-465bc3ee-370c-4bb6-a3b7-c98f83787bdb service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] No waiting events found dispatching network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:41 user nova-compute[73476]: WARNING nova.compute.manager [req-c4a0dfa4-525b-4c50-899d-aaa0b5ed56ff req-465bc3ee-370c-4bb6-a3b7-c98f83787bdb service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received unexpected event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 for instance with vm_state building and task_state spawning.
Aug 26 20:55:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-e79e6c09-1949-4e39-ad62-85c15c3d573d req-08041afb-543e-46af-9450-59c31dbd446c service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-changed-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-e79e6c09-1949-4e39-ad62-85c15c3d573d req-08041afb-543e-46af-9450-59c31dbd446c service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Refreshing instance network info cache due to event network-changed-6584605e-8134-4b8a-823b-c7fa91e9edf2. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e79e6c09-1949-4e39-ad62-85c15c3d573d req-08041afb-543e-46af-9450-59c31dbd446c service nova] Acquiring lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e79e6c09-1949-4e39-ad62-85c15c3d573d req-08041afb-543e-46af-9450-59c31dbd446c service nova] Acquired lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG nova.network.neutron [req-e79e6c09-1949-4e39-ad62-85c15c3d573d req-08041afb-543e-46af-9450-59c31dbd446c service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Refreshing network info cache for port 6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG nova.network.neutron [req-e79e6c09-1949-4e39-ad62-85c15c3d573d req-08041afb-543e-46af-9450-59c31dbd446c service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updated VIF entry in instance network info cache for port 6584605e-8134-4b8a-823b-c7fa91e9edf2. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG nova.network.neutron [req-e79e6c09-1949-4e39-ad62-85c15c3d573d req-08041afb-543e-46af-9450-59c31dbd446c service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating instance_info_cache with network_info: [{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e79e6c09-1949-4e39-ad62-85c15c3d573d req-08041afb-543e-46af-9450-59c31dbd446c service nova] Releasing lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083343.14539, a015ae4b-1bc1-4748-839f-7a380bd002d9 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:43 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] VM Resumed (Lifecycle Event)
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:55:43 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Instance spawned successfully.
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-23adf1c6-a7c0-44fa-9f8c-36920185eb3a req-17d947f3-9b3a-49b8-a361-7f31bd8887a1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-23adf1c6-a7c0-44fa-9f8c-36920185eb3a req-17d947f3-9b3a-49b8-a361-7f31bd8887a1 service nova] Acquiring lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-23adf1c6-a7c0-44fa-9f8c-36920185eb3a req-17d947f3-9b3a-49b8-a361-7f31bd8887a1 service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-23adf1c6-a7c0-44fa-9f8c-36920185eb3a req-17d947f3-9b3a-49b8-a361-7f31bd8887a1 service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-23adf1c6-a7c0-44fa-9f8c-36920185eb3a req-17d947f3-9b3a-49b8-a361-7f31bd8887a1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] No waiting events found dispatching network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:43 user nova-compute[73476]: WARNING nova.compute.manager [req-23adf1c6-a7c0-44fa-9f8c-36920185eb3a req-17d947f3-9b3a-49b8-a361-7f31bd8887a1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received unexpected event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 for instance with vm_state building and task_state spawning.
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:55:43 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083343.146956, a015ae4b-1bc1-4748-839f-7a380bd002d9 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:43 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] VM Started (Lifecycle Event)
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:43 user nova-compute[73476]: INFO nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:55:43 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:55:43 user nova-compute[73476]: INFO nova.compute.manager [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Took 7.44 seconds to build instance.
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1150f66a-f3b9-4553-8a96-41ef6630e16a tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.527s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083328.5888674, 6de9ed93-5d15-49cc-82fd-f4822fae54af => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:55:43 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] VM Stopped (Lifecycle Event)
Aug 26 20:55:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ee136088-774f-4060-b267-a717a08031fe None None] [instance: 6de9ed93-5d15-49cc-82fd-f4822fae54af] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:47 user nova-compute[73476]: INFO nova.compute.manager [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Shelving
Aug 26 20:55:47 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:55:47 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=6640MB free_disk=24.925655364990234GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Applying migration context for instance aae763e2-8571-4c3f-91e3-4cc501b3d335 as it has an incoming, in-progress migration bf73e749-6959-4731-b116-379407616db4. Migration status is error {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=73476) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1dddc689-a053-46d4-a29e-52c8fe78c76d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ed515d2d-7ad6-48bb-b353-abc4e620156c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8644e702-6fc8-4c84-a208-ef9a78cda0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 762ffba7-912d-40d7-af19-667df1760dc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e7f5df96-9852-49ee-b42a-0a1132e07efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance aae763e2-8571-4c3f-91e3-4cc501b3d335 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance a015ae4b-1bc1-4748-839f-7a380bd002d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:55:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:55:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-3d390438-c4a9-4ee6-b8da-a4b5cb99b02c req-24ab7eae-3656-4909-8d21-77eb00483f82 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-unplugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3d390438-c4a9-4ee6-b8da-a4b5cb99b02c req-24ab7eae-3656-4909-8d21-77eb00483f82 service nova] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3d390438-c4a9-4ee6-b8da-a4b5cb99b02c req-24ab7eae-3656-4909-8d21-77eb00483f82 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3d390438-c4a9-4ee6-b8da-a4b5cb99b02c req-24ab7eae-3656-4909-8d21-77eb00483f82 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-3d390438-c4a9-4ee6-b8da-a4b5cb99b02c req-24ab7eae-3656-4909-8d21-77eb00483f82 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] No waiting events found dispatching network-vif-unplugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:48 user nova-compute[73476]: WARNING nova.compute.manager [req-3d390438-c4a9-4ee6-b8da-a4b5cb99b02c req-24ab7eae-3656-4909-8d21-77eb00483f82 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received unexpected event network-vif-unplugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 for instance with vm_state active and task_state shelving.
Aug 26 20:55:48 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:55:48 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:55:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:55:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.730s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance destroyed successfully.
Aug 26 20:55:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Beginning cold snapshot process
Aug 26 20:55:48 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:55:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk /opt/stack/data/nova/instances/snapshots/tmpjr28nb5x/02e2cba67fe74e91a0a903e524d4f17b {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk /opt/stack/data/nova/instances/snapshots/tmpjr28nb5x/02e2cba67fe74e91a0a903e524d4f17b" returned: 0 in 0.872s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Snapshot extracted, beginning image upload
Aug 26 20:55:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-0de13c1b-502c-4784-a0d7-2937259f4d35 req-fb4d4508-0fb4-4973-96cf-150d18f115ab service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0de13c1b-502c-4784-a0d7-2937259f4d35 req-fb4d4508-0fb4-4973-96cf-150d18f115ab service nova] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0de13c1b-502c-4784-a0d7-2937259f4d35 req-fb4d4508-0fb4-4973-96cf-150d18f115ab service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0de13c1b-502c-4784-a0d7-2937259f4d35 req-fb4d4508-0fb4-4973-96cf-150d18f115ab service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-0de13c1b-502c-4784-a0d7-2937259f4d35 req-fb4d4508-0fb4-4973-96cf-150d18f115ab service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] No waiting events found dispatching network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:55:50 user nova-compute[73476]: WARNING nova.compute.manager [req-0de13c1b-502c-4784-a0d7-2937259f4d35 req-fb4d4508-0fb4-4973-96cf-150d18f115ab service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received unexpected event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 20:55:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 22b50300-8865-4854-b0c7-ed63ca60c85b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:55:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updating instance_info_cache with network_info: [{"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-22b50300-8865-4854-b0c7-ed63ca60c85b" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxemqrVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:55:51 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:55:51 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:55:51 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eedb859-db12-4590-bd11-e30445cf330a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:55:51 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9027cc5d-90b8-4e7b-93dd-e6234b74f771]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680] added
Aug 26 20:55:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c74289-cf43-430c-82fe-ebd5f80e9231]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa7f678-00d9-43de-a785-6d8c66f9c83d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxemqrVi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxemqrVi" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a805c54e-3891-44c0-b892-b54299ad6c1a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxemqrVi'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33fd108-5186-4fef-aafe-d3461c41a4f9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[74da6bb9-390e-4236-85d1-1cfef3b3bdcd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a650aa-a4e2-4f04-a622-27235d8d7aff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680, portal: 172.16.0.220,3260]
Aug 26 20:55:51 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680, portal: 172.16.0.220,3260] successful.
Aug 26 20:55:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c20e22d-9de1-49cd-9ff2-361658a6bc1a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d01f57-c08b-4202-9764-201ede9b1559]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 (non-flash)
Aug 26 20:55:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:51 user nova-compute[73476]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 (non-flash)
Aug 26 20:55:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aa80ba-8c93-428d-9d3c-16436fdf8887]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:55:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxemqrVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:55:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Snapshot image upload complete
Aug 26 20:55:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:52 user nova-compute[73476]: INFO nova.compute.manager [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Shelve offloading
Aug 26 20:55:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance destroyed successfully.
Aug 26 20:55:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:55:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquired lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:52 user nova-compute[73476]: DEBUG nova.network.neutron [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:55:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:55:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23066393162386631', 'path': '/dev/sdd'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:55:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066393162386631', 'path': '/dev/sdd'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:55:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'flavor' on Instance uuid 762ffba7-912d-40d7-af19-667df1760dc6 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:55:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:55:52 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:55:52 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 20:55:52 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:55:52 user nova-compute[73476]:   <serial>3f620d47-4110-4800-a71f-da992095c680</serial>
Aug 26 20:55:52 user nova-compute[73476]: </disk>
Aug 26 20:55:52 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:55:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:55:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:55:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No VIF found with MAC fa:16:3e:b2:be:90, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:55:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating instance_info_cache with network_info: [{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Releasing lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d7f6314-9753-4dfa-a805-13d9a7b949ab tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.668s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:54 user nova-compute[73476]: INFO nova.compute.manager [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Detaching volume 3f620d47-4110-4800-a71f-da992095c680
Aug 26 20:55:54 user nova-compute[73476]: INFO nova.virt.block_device [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Attempting to driver detach volume 3f620d47-4110-4800-a71f-da992095c680 from mountpoint /dev/vdb
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Attempting to detach device vdb from instance 762ffba7-912d-40d7-af19-667df1760dc6 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:55:54 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:55:54 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 20:55:54 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:55:54 user nova-compute[73476]:   <serial>3f620d47-4110-4800-a71f-da992095c680</serial>
Aug 26 20:55:54 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:55:54 user nova-compute[73476]: </disk>
Aug 26 20:55:54 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:55:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully detached device vdb from instance 762ffba7-912d-40d7-af19-667df1760dc6 from the persistent domain config.
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 762ffba7-912d-40d7-af19-667df1760dc6 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:55:54 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:55:54 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 20:55:54 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:55:54 user nova-compute[73476]:   <serial>3f620d47-4110-4800-a71f-da992095c680</serial>
Aug 26 20:55:54 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:55:54 user nova-compute[73476]: </disk>
Aug 26 20:55:54 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:55:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance destroyed successfully.
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'resources' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3dfb407-7810-434e-ba38-46e9c4d71cb3 req-a62c96b0-47ae-47ce-8b26-23cf91324e87 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-changed-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-b3dfb407-7810-434e-ba38-46e9c4d71cb3 req-a62c96b0-47ae-47ce-8b26-23cf91324e87 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Refreshing instance network info cache due to event network-changed-6584605e-8134-4b8a-823b-c7fa91e9edf2. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3dfb407-7810-434e-ba38-46e9c4d71cb3 req-a62c96b0-47ae-47ce-8b26-23cf91324e87 service nova] Acquiring lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3dfb407-7810-434e-ba38-46e9c4d71cb3 req-a62c96b0-47ae-47ce-8b26-23cf91324e87 service nova] Acquired lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-b3dfb407-7810-434e-ba38-46e9c4d71cb3 req-a62c96b0-47ae-47ce-8b26-23cf91324e87 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Refreshing network info cache for port 6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1749490198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1749490198',id=32,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENYUdp9PpxnlBViq6RckJL4WVsGonAfQOV+tESM+2KUxv9mCIOfNWZgsfuu2Du6Q2DPctsZfXI/n6oQ7xLntfwWy4lyF0e1opIpDGuNToQE+SfJAFfeXDiXhMnu/kapFg==',key_name='tempest-keypair-2072190721',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-alt09urc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member',shelved_at='2023-08-26T20:55:52.258252',shelved_host='user',shelved_image_id='768847b8-6db1-4ec0-bc32-5787b1ab7b7a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=4fdf4aae-7ecd-448a-974d-56ff46abd39a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG os_vif [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6584605e-81, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:55:54 user nova-compute[73476]: INFO os_vif [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81')
Aug 26 20:55:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Deleting instance files /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a_del
Aug 26 20:55:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Deletion of /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a_del complete
Aug 26 20:55:54 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Deleted allocations for instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'numa_topology' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.objects.base [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<4fdf4aae-7ecd-448a-974d-56ff46abd39a> lazy-loaded attributes: resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083354.891086, 762ffba7-912d-40d7-af19-667df1760dc6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 762ffba7-912d-40d7-af19-667df1760dc6 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:55:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully detached device vdb from instance 762ffba7-912d-40d7-af19-667df1760dc6 from the live domain config.
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxemqrVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:55:54 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:55:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a33a646-789f-4fe0-b9cf-bac8f7c2386d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-b3dfb407-7810-434e-ba38-46e9c4d71cb3 req-a62c96b0-47ae-47ce-8b26-23cf91324e87 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updated VIF entry in instance network info cache for port 6584605e-8134-4b8a-823b-c7fa91e9edf2. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-b3dfb407-7810-434e-ba38-46e9c4d71cb3 req-a62c96b0-47ae-47ce-8b26-23cf91324e87 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating instance_info_cache with network_info: [{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6584605e-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87ad9de-943f-4377-9cc2-b260b657e626]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:54 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:54 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:54 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:54 user nova-compute[73476]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 (non-flash)
Aug 26 20:55:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:55:54 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:55:54 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:55:54 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:55:54 user nova-compute[73476]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 (non-flash)
Aug 26 20:55:54 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02ded40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680'): ({'sdd'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Removing single pathed devices sdd {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b3dfb407-7810-434e-ba38-46e9c4d71cb3 req-a62c96b0-47ae-47ce-8b26-23cf91324e87 service nova] Releasing lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:54 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2572f4-845b-4492-83c9-807429480ecd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[999ca231-9d83-4f52-8208-9e6ecc536954]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flushing IO for device /dev/sdd {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee51b1e5-4286-493d-8ff8-624cb2c055d1]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c8f65b-bc56-4a31-a286-f996382bce4f]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b2dafa-4310-4be5-b861-a6e88d991d78]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68c1a0c-7137-4016-900e-b6238a32e594]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680, portal: 172.16.0.220,3260]
Aug 26 20:55:55 user nova-compute[73476]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680, portal: 172.16.0.220,3260] successful.
Aug 26 20:55:55 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f620d47-4110-4800-a71f-da992095c680 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[728115fe-ed98-483a-b730-51cd820bd2b7]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] <== disconnect_volume: return (332ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:55:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-add6e6f8-7739-48a0-88a8-117aee012eed tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.127s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:56 user nova-compute[73476]: DEBUG nova.objects.instance [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'flavor' on Instance uuid 762ffba7-912d-40d7-af19-667df1760dc6 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:55:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-05c881c3-b95f-4b00-969f-96dc03c60143 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.840s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:55:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:55:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:03 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083348.4012828, 4fdf4aae-7ecd-448a-974d-56ff46abd39a => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:56:03 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] VM Stopped (Lifecycle Event)
Aug 26 20:56:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4cdfbb8c-0bd8-4c1b-a358-164d733e41a4 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-5cc4248f-31c4-4dfe-bf02-a6c115647329 req-8d247f58-6bb2-4dda-8cf1-aaffe34cfd40 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-changed-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-5cc4248f-31c4-4dfe-bf02-a6c115647329 req-8d247f58-6bb2-4dda-8cf1-aaffe34cfd40 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Refreshing instance network info cache due to event network-changed-3c33176d-b04b-4fcd-9e30-e2b9799af0c4. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5cc4248f-31c4-4dfe-bf02-a6c115647329 req-8d247f58-6bb2-4dda-8cf1-aaffe34cfd40 service nova] Acquiring lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5cc4248f-31c4-4dfe-bf02-a6c115647329 req-8d247f58-6bb2-4dda-8cf1-aaffe34cfd40 service nova] Acquired lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-5cc4248f-31c4-4dfe-bf02-a6c115647329 req-8d247f58-6bb2-4dda-8cf1-aaffe34cfd40 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Refreshing network info cache for port 3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:04 user nova-compute[73476]: INFO nova.compute.manager [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Detaching volume 00045f26-cd8a-413c-b733-33ea0beddaf3
Aug 26 20:56:04 user nova-compute[73476]: INFO nova.virt.block_device [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Attempting to driver detach volume 00045f26-cd8a-413c-b733-33ea0beddaf3 from mountpoint /dev/vdb
Aug 26 20:56:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-5cc4248f-31c4-4dfe-bf02-a6c115647329 req-8d247f58-6bb2-4dda-8cf1-aaffe34cfd40 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updated VIF entry in instance network info cache for port 3c33176d-b04b-4fcd-9e30-e2b9799af0c4. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG nova.network.neutron [req-5cc4248f-31c4-4dfe-bf02-a6c115647329 req-8d247f58-6bb2-4dda-8cf1-aaffe34cfd40 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating instance_info_cache with network_info: [{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Attempting to detach device vdb from instance ed515d2d-7ad6-48bb-b353-abc4e620156c from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:56:04 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:56:04 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 20:56:04 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:56:04 user nova-compute[73476]:   <serial>00045f26-cd8a-413c-b733-33ea0beddaf3</serial>
Aug 26 20:56:04 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:56:04 user nova-compute[73476]: </disk>
Aug 26 20:56:04 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:56:04 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Successfully detached device vdb from instance ed515d2d-7ad6-48bb-b353-abc4e620156c from the persistent domain config.
Aug 26 20:56:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed515d2d-7ad6-48bb-b353-abc4e620156c from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:56:04 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:56:04 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 20:56:04 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:56:04 user nova-compute[73476]:   <serial>00045f26-cd8a-413c-b733-33ea0beddaf3</serial>
Aug 26 20:56:04 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:56:04 user nova-compute[73476]: </disk>
Aug 26 20:56:04 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:56:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5cc4248f-31c4-4dfe-bf02-a6c115647329 req-8d247f58-6bb2-4dda-8cf1-aaffe34cfd40 service nova] Releasing lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083365.2048092, ed515d2d-7ad6-48bb-b353-abc4e620156c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:56:05 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Successfully detached device vdb from instance ed515d2d-7ad6-48bb-b353-abc4e620156c from the live domain config.
Aug 26 20:56:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JosxYatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:56:05 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[171325e8-a513-460e-921e-2a3330d54193]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[863eaa70-2756-4b84-a398-37f9bc8783c4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:56:05 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:56:05 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:56:05 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:56:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:56:05 user nova-compute[73476]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 (non-flash)
Aug 26 20:56:05 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:56:05 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:56:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02dd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c15860-35ac-4845-bae1-92f924defe1b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a20b8d-fb0e-4b8a-afc6-a5c8ea0a0632]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20ae2cd-25e5-4bc2-b549-9120389bfc22]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9815695-693c-47a3-b2cd-5ab6a45dccd4]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a5c6ff-2034-4300-beb3-c6112749ab4f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[062c4bf8-04f9-4b54-8bff-632cb00e2a9a]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3, portal: 172.16.0.220,3260]
Aug 26 20:56:05 user nova-compute[73476]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3, portal: 172.16.0.220,3260] successful.
Aug 26 20:56:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00045f26-cd8a-413c-b733-33ea0beddaf3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61da9a5-aca3-4d30-a329-c40f58ec92b4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] <== disconnect_volume: return (296ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:56:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-dd57632c-2938-47e9-b432-33a75fdc22aa req-d37375de-e068-4332-af06-4c33d671f1b6 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-changed-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-dd57632c-2938-47e9-b432-33a75fdc22aa req-d37375de-e068-4332-af06-4c33d671f1b6 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Refreshing instance network info cache due to event network-changed-3c33176d-b04b-4fcd-9e30-e2b9799af0c4. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dd57632c-2938-47e9-b432-33a75fdc22aa req-d37375de-e068-4332-af06-4c33d671f1b6 service nova] Acquiring lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dd57632c-2938-47e9-b432-33a75fdc22aa req-d37375de-e068-4332-af06-4c33d671f1b6 service nova] Acquired lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG nova.network.neutron [req-dd57632c-2938-47e9-b432-33a75fdc22aa req-d37375de-e068-4332-af06-4c33d671f1b6 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Refreshing network info cache for port 3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG nova.objects.instance [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'flavor' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b4f0f952-3845-477c-98dd-500d9bf1616c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG nova.network.neutron [req-dd57632c-2938-47e9-b432-33a75fdc22aa req-d37375de-e068-4332-af06-4c33d671f1b6 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updated VIF entry in instance network info cache for port 3c33176d-b04b-4fcd-9e30-e2b9799af0c4. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG nova.network.neutron [req-dd57632c-2938-47e9-b432-33a75fdc22aa req-d37375de-e068-4332-af06-4c33d671f1b6 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating instance_info_cache with network_info: [{"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dd57632c-2938-47e9-b432-33a75fdc22aa req-d37375de-e068-4332-af06-4c33d671f1b6 service nova] Releasing lock "refresh_cache-ed515d2d-7ad6-48bb-b353-abc4e620156c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:56:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquiring lock "e7f5df96-9852-49ee-b42a-0a1132e07efc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquiring lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:20 user nova-compute[73476]: INFO nova.compute.manager [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Terminating instance
Aug 26 20:56:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-aa561a60-399e-4ae9-9b22-8a8a7cf57375 req-1fb0f40d-e342-4189-9dad-21ee4a17443e service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received event network-vif-unplugged-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-aa561a60-399e-4ae9-9b22-8a8a7cf57375 req-1fb0f40d-e342-4189-9dad-21ee4a17443e service nova] Acquiring lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-aa561a60-399e-4ae9-9b22-8a8a7cf57375 req-1fb0f40d-e342-4189-9dad-21ee4a17443e service nova] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-aa561a60-399e-4ae9-9b22-8a8a7cf57375 req-1fb0f40d-e342-4189-9dad-21ee4a17443e service nova] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-aa561a60-399e-4ae9-9b22-8a8a7cf57375 req-1fb0f40d-e342-4189-9dad-21ee4a17443e service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] No waiting events found dispatching network-vif-unplugged-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-aa561a60-399e-4ae9-9b22-8a8a7cf57375 req-1fb0f40d-e342-4189-9dad-21ee4a17443e service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received event network-vif-unplugged-d397682f-4084-45ae-a774-9bb14073ba36 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:56:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Instance destroyed successfully.
Aug 26 20:56:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lazy-loading 'resources' on Instance uuid e7f5df96-9852-49ee-b42a-0a1132e07efc {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-898052171',display_name='tempest-VolumesNegativeTest-instance-898052171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-898052171',id=33,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='314db0b9914f48d4bc0277dc913e76d6',ramdisk_id='',reservation_id='r-j2pjonoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-398040337',owner_user_name='tempest-VolumesNegativeTest-398040337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:54:37Z,user_data=None,user_id='96c598813dad47f3a6b10fe907574b1b',uuid=e7f5df96-9852-49ee-b42a-0a1132e07efc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Converting VIF {"id": "d397682f-4084-45ae-a774-9bb14073ba36", "address": "fa:16:3e:e0:c5:9e", "network": {"id": "53f0d360-df05-463a-bda0-b8d1e7bbb817", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a5651794d8ac4f3286e58172df99c438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd397682f-40", "ovs_interfaceid": "d397682f-4084-45ae-a774-9bb14073ba36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c5:9e,bridge_name='br-int',has_traffic_filtering=True,id=d397682f-4084-45ae-a774-9bb14073ba36,network=Network(53f0d360-df05-463a-bda0-b8d1e7bbb817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd397682f-40') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG os_vif [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c5:9e,bridge_name='br-int',has_traffic_filtering=True,id=d397682f-4084-45ae-a774-9bb14073ba36,network=Network(53f0d360-df05-463a-bda0-b8d1e7bbb817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd397682f-40') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd397682f-40, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:21 user nova-compute[73476]: INFO os_vif [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c5:9e,bridge_name='br-int',has_traffic_filtering=True,id=d397682f-4084-45ae-a774-9bb14073ba36,network=Network(53f0d360-df05-463a-bda0-b8d1e7bbb817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd397682f-40')
Aug 26 20:56:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Deleting instance files /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc_del
Aug 26 20:56:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Deletion of /opt/stack/data/nova/instances/e7f5df96-9852-49ee-b42a-0a1132e07efc_del complete
Aug 26 20:56:21 user nova-compute[73476]: INFO nova.compute.manager [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 26 20:56:21 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:21 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Took 0.59 seconds to deallocate network for instance.
Aug 26 20:56:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:22 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:56:22 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:56:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:22 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Deleted allocations for instance e7f5df96-9852-49ee-b42a-0a1132e07efc
Aug 26 20:56:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c5819579-a663-41aa-94e0-87f791c9a109 tempest-VolumesNegativeTest-398040337 tempest-VolumesNegativeTest-398040337-project-member] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.905s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-f5a9383b-4bc6-485d-983f-3e50b72e7ffd req-b368afab-ce12-47be-894f-116ed2087a5c service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received event network-vif-plugged-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f5a9383b-4bc6-485d-983f-3e50b72e7ffd req-b368afab-ce12-47be-894f-116ed2087a5c service nova] Acquiring lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f5a9383b-4bc6-485d-983f-3e50b72e7ffd req-b368afab-ce12-47be-894f-116ed2087a5c service nova] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f5a9383b-4bc6-485d-983f-3e50b72e7ffd req-b368afab-ce12-47be-894f-116ed2087a5c service nova] Lock "e7f5df96-9852-49ee-b42a-0a1132e07efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-f5a9383b-4bc6-485d-983f-3e50b72e7ffd req-b368afab-ce12-47be-894f-116ed2087a5c service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] No waiting events found dispatching network-vif-plugged-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:22 user nova-compute[73476]: WARNING nova.compute.manager [req-f5a9383b-4bc6-485d-983f-3e50b72e7ffd req-b368afab-ce12-47be-894f-116ed2087a5c service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received unexpected event network-vif-plugged-d397682f-4084-45ae-a774-9bb14073ba36 for instance with vm_state deleted and task_state None.
Aug 26 20:56:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-f5a9383b-4bc6-485d-983f-3e50b72e7ffd req-b368afab-ce12-47be-894f-116ed2087a5c service nova] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Received event network-vif-deleted-d397682f-4084-45ae-a774-9bb14073ba36 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:56:31 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:56:32 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:56:32 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:56:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:56:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:56:36 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083381.222095, e7f5df96-9852-49ee-b42a-0a1132e07efc => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:56:36 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] VM Stopped (Lifecycle Event)
Aug 26 20:56:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0eb3c9e2-cbbd-4eee-87cd-6929187a1cfd None None] [instance: e7f5df96-9852-49ee-b42a-0a1132e07efc] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:56:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:56:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:56:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:39 user nova-compute[73476]: DEBUG nova.objects.instance [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'flavor' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:56:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:40 user nova-compute[73476]: INFO nova.compute.manager [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Attaching volume 6d25776e-2b92-4555-84ca-998d013c2032 to /dev/vdb
Aug 26 20:56:40 user nova-compute[73476]: DEBUG os_brick.utils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2b221b-21a4-40a4-99dd-faadcfec8e77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[36080296-eb30-4011-9148-755b2259c3d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a6d620-562f-4582-92cb-685e7b13d81b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ff4a4f-b6e8-449c-8b20-35ff5f592458]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:56:40 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:56:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[96170dde-9cb7-4b4c-92d1-e182c2339fac]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG os_brick.utils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:56:40 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating existing volume attachment record: 6217d238-8cb2-441f-8ade-c1493031899b {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:56:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:56:41 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:56:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:41 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:56:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:56:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:42 user nova-compute[73476]: INFO nova.compute.manager [None req-d4a80937-9925-4e6c-bd5d-c43503ca2b79 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Unrescuing
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d4a80937-9925-4e6c-bd5d-c43503ca2b79 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d4a80937-9925-4e6c-bd5d-c43503ca2b79 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquired lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d4a80937-9925-4e6c-bd5d-c43503ca2b79 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG nova.compute.manager [req-ab12e9df-230d-4f49-9a57-f9b520d48362 req-3d52ccec-355d-4199-acca-c71e7e3f312e service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG nova.compute.manager [req-ab12e9df-230d-4f49-9a57-f9b520d48362 req-3d52ccec-355d-4199-acca-c71e7e3f312e service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing instance network info cache due to event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ab12e9df-230d-4f49-9a57-f9b520d48362 req-3d52ccec-355d-4199-acca-c71e7e3f312e service nova] Acquiring lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ab12e9df-230d-4f49-9a57-f9b520d48362 req-3d52ccec-355d-4199-acca-c71e7e3f312e service nova] Acquired lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG nova.network.neutron [req-ab12e9df-230d-4f49-9a57-f9b520d48362 req-3d52ccec-355d-4199-acca-c71e7e3f312e service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d4a80937-9925-4e6c-bd5d-c43503ca2b79 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Updating instance_info_cache with network_info: [{"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d4a80937-9925-4e6c-bd5d-c43503ca2b79 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Releasing lock "refresh_cache-8644e702-6fc8-4c84-a208-ef9a78cda0ee" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d4a80937-9925-4e6c-bd5d-c43503ca2b79 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'flavor' on Instance uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-b734bac2-3b01-4835-ae77-11cb0bd020ea req-27fe0fba-ed65-4a65-b7af-d2624400b2dc service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-unplugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b734bac2-3b01-4835-ae77-11cb0bd020ea req-27fe0fba-ed65-4a65-b7af-d2624400b2dc service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b734bac2-3b01-4835-ae77-11cb0bd020ea req-27fe0fba-ed65-4a65-b7af-d2624400b2dc service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b734bac2-3b01-4835-ae77-11cb0bd020ea req-27fe0fba-ed65-4a65-b7af-d2624400b2dc service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-b734bac2-3b01-4835-ae77-11cb0bd020ea req-27fe0fba-ed65-4a65-b7af-d2624400b2dc service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-unplugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:43 user nova-compute[73476]: WARNING nova.compute.manager [req-b734bac2-3b01-4835-ae77-11cb0bd020ea req-27fe0fba-ed65-4a65-b7af-d2624400b2dc service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-unplugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:56:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-ab12e9df-230d-4f49-9a57-f9b520d48362 req-3d52ccec-355d-4199-acca-c71e7e3f312e service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updated VIF entry in instance network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-ab12e9df-230d-4f49-9a57-f9b520d48362 req-3d52ccec-355d-4199-acca-c71e7e3f312e service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updating instance_info_cache with network_info: [{"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ab12e9df-230d-4f49-9a57-f9b520d48362 req-3d52ccec-355d-4199-acca-c71e7e3f312e service nova] Releasing lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:56:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:43 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Instance destroyed successfully.
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:44 user nova-compute[73476]: INFO nova.compute.manager [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Detaching volume 99984eae-48cd-466d-a691-43213e3a84cf
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:44 user nova-compute[73476]: INFO nova.virt.block_device [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Attempting to driver detach volume 99984eae-48cd-466d-a691-43213e3a84cf from mountpoint /dev/vdb
Aug 26 20:56:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Attempting to detach device vdb from instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:56:44 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:56:44 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:56:44 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:56:44 user nova-compute[73476]:   <serial>99984eae-48cd-466d-a691-43213e3a84cf</serial>
Aug 26 20:56:44 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:56:44 user nova-compute[73476]: </disk>
Aug 26 20:56:44 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:56:44 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully detached device vdb from instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 from the persistent domain config.
Aug 26 20:56:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:56:44 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:56:44 user nova-compute[73476]:   <source dev="/dev/sde"/>
Aug 26 20:56:44 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:56:44 user nova-compute[73476]:   <serial>99984eae-48cd-466d-a691-43213e3a84cf</serial>
Aug 26 20:56:44 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:56:44 user nova-compute[73476]: </disk>
Aug 26 20:56:44 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:44 user nova-compute[73476]: INFO nova.compute.manager [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Terminating instance
Aug 26 20:56:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.279s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-7fd94b69-fe99-46b0-9450-4063d75cae8b req-e7e61636-f773-45e2-bc2c-f4050603c659 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received event network-vif-unplugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7fd94b69-fe99-46b0-9450-4063d75cae8b req-e7e61636-f773-45e2-bc2c-f4050603c659 service nova] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7fd94b69-fe99-46b0-9450-4063d75cae8b req-e7e61636-f773-45e2-bc2c-f4050603c659 service nova] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7fd94b69-fe99-46b0-9450-4063d75cae8b req-e7e61636-f773-45e2-bc2c-f4050603c659 service nova] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-7fd94b69-fe99-46b0-9450-4063d75cae8b req-e7e61636-f773-45e2-bc2c-f4050603c659 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] No waiting events found dispatching network-vif-unplugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-7fd94b69-fe99-46b0-9450-4063d75cae8b req-e7e61636-f773-45e2-bc2c-f4050603c659 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received event network-vif-unplugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083405.5039961, d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:56:45 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully detached device vdb from instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 from the live domain config.
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oWMRTZgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:56:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[484ce0db-8074-4c96-bbc2-32d02b90c212]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e5ab37-a4f7-4724-a8a4-44310d5eccba]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:56:45 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:56:45 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:56:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:56:45 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:56:45 user nova-compute[73476]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf (non-flash)
Aug 26 20:56:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02a3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf'): ({'sde'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Removing single pathed devices sde {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6b8c08-42ef-4478-9645-36ffdd045729]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ed601-4ea9-45ee-88d5-6ae9ecc49025]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Flushing IO for device /dev/sde {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:45 user nova-compute[73476]: WARNING nova.compute.manager [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing instance network info cache due to event network-changed-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] Acquiring lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] Acquired lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.network.neutron [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Refreshing network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[17853f8f-2540-4e89-81f0-111847fe2c6c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a5505c-4f93-45b9-8bd2-1214998b17bb]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] SCSI volumes sde have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ce3875-0a21-4889-a469-366d80fa353c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d6864f-5fc4-4929-b2c1-5520ca8428b1]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf, portal: 172.16.0.220,3260]
Aug 26 20:56:45 user nova-compute[73476]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf, portal: 172.16.0.220,3260] successful.
Aug 26 20:56:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99984eae-48cd-466d-a691-43213e3a84cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afa3853-e2fa-442b-a5c1-2d3791911931]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] <== disconnect_volume: return (354ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:56:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:46 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Instance destroyed successfully.
Aug 26 20:56:46 user nova-compute[73476]: DEBUG nova.objects.instance [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'resources' on Instance uuid 762ffba7-912d-40d7-af19-667df1760dc6 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-810120167',display_name='tempest-AttachVolumeNegativeTest-server-810120167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-810120167',id=31,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB326H1hORARohmS0QMx16K1kiab5CDxKToODqbp58mpvZV6rqdCYM9cq24gxeAM1azRytT+enqYJnkVjpumN6Df0QnTWE2ODxINasA6MzAliC9tS1l4O2oQiEKK/OOHnA==',key_name='tempest-keypair-1756930200',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-ng58qqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:53:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=762ffba7-912d-40d7-af19-667df1760dc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "address": "fa:16:3e:b2:be:90", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2051ba09-6f", "ovs_interfaceid": "2051ba09-6f5f-41b3-b088-5e4ef66c89bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:be:90,bridge_name='br-int',has_traffic_filtering=True,id=2051ba09-6f5f-41b3-b088-5e4ef66c89bc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2051ba09-6f') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG os_vif [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:be:90,bridge_name='br-int',has_traffic_filtering=True,id=2051ba09-6f5f-41b3-b088-5e4ef66c89bc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2051ba09-6f') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2051ba09-6f, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:56:46 user nova-compute[73476]: INFO os_vif [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:be:90,bridge_name='br-int',has_traffic_filtering=True,id=2051ba09-6f5f-41b3-b088-5e4ef66c89bc,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2051ba09-6f')
Aug 26 20:56:46 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Deleting instance files /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6_del
Aug 26 20:56:46 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Deletion of /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6_del complete
Aug 26 20:56:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updated VIF entry in instance network info cache for port bfeb0f7e-f5b7-497e-a0f4-75d7b5263923. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updating instance_info_cache with network_info: [{"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b69d3655-7e34-4713-8a2f-a6d326a39e9e req-1b10ea5e-bf52-498c-a458-08f26ee280c7 service nova] Releasing lock "refresh_cache-d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:56:46 user nova-compute[73476]: INFO nova.compute.manager [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Took 1.71 seconds to destroy the instance on the hypervisor.
Aug 26 20:56:46 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json" returned: 1 in 0.261s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk --force-share --output=json' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:56:46 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001f, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/762ffba7-912d-40d7-af19-667df1760dc6/disk
Aug 26 20:56:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-c5264dbb-57ed-46ca-9a19-52de8c7fa442 req-29b4a51a-8b17-46c7-9b10-f4c75d377575 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received event network-vif-plugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c5264dbb-57ed-46ca-9a19-52de8c7fa442 req-29b4a51a-8b17-46c7-9b10-f4c75d377575 service nova] Acquiring lock "762ffba7-912d-40d7-af19-667df1760dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c5264dbb-57ed-46ca-9a19-52de8c7fa442 req-29b4a51a-8b17-46c7-9b10-f4c75d377575 service nova] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-c5264dbb-57ed-46ca-9a19-52de8c7fa442 req-29b4a51a-8b17-46c7-9b10-f4c75d377575 service nova] Lock "762ffba7-912d-40d7-af19-667df1760dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-c5264dbb-57ed-46ca-9a19-52de8c7fa442 req-29b4a51a-8b17-46c7-9b10-f4c75d377575 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] No waiting events found dispatching network-vif-plugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:47 user nova-compute[73476]: WARNING nova.compute.manager [req-c5264dbb-57ed-46ca-9a19-52de8c7fa442 req-29b4a51a-8b17-46c7-9b10-f4c75d377575 service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received unexpected event network-vif-plugged-2051ba09-6f5f-41b3-b088-5e4ef66c89bc for instance with vm_state active and task_state deleting.
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:47 user nova-compute[73476]: WARNING nova.compute.manager [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:56:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:47 user nova-compute[73476]: WARNING nova.compute.manager [req-adc6f48a-c774-4428-8433-0825c80b019f req-4551e0f8-354e-44a2-a840-31fca9355b09 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:56:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:47 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Took 1.31 seconds to deallocate network for instance.
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-e2957e7c-b0ea-4b1d-8e21-a5482a41f834 req-93efec33-74ff-4619-8e76-1de150c4813a service nova] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Received event network-vif-deleted-2051ba09-6f5f-41b3-b088-5e4ef66c89bc {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.688s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:48 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Deleted allocations for instance 762ffba7-912d-40d7-af19-667df1760dc6
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for 8644e702-6fc8-4c84-a208-ef9a78cda0ee due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083408.8448176, 8644e702-6fc8-4c84-a208-ef9a78cda0ee => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:56:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] VM Resumed (Lifecycle Event)
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d4a80937-9925-4e6c-bd5d-c43503ca2b79 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5972f34e-d6a4-41f4-b6aa-074763b8720d tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "762ffba7-912d-40d7-af19-667df1760dc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.104s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083408.8453248, 8644e702-6fc8-4c84-a208-ef9a78cda0ee => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:56:48 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] VM Started (Lifecycle Event)
Aug 26 20:56:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:56:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:56:49 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:56:49 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=6983MB free_disk=24.900238037109375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Applying migration context for instance aae763e2-8571-4c3f-91e3-4cc501b3d335 as it has an incoming, in-progress migration bf73e749-6959-4731-b116-379407616db4. Migration status is error {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=73476) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1dddc689-a053-46d4-a29e-52c8fe78c76d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ed515d2d-7ad6-48bb-b353-abc4e620156c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8644e702-6fc8-4c84-a208-ef9a78cda0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance aae763e2-8571-4c3f-91e3-4cc501b3d335 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance a015ae4b-1bc1-4748-839f-7a380bd002d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:56:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:56:50 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:56:50 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:56:50 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:56:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:56:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:56:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:56:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:56:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:56:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:56:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updating instance_info_cache with network_info: [{"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-531953d6-502b-4f11-8a53-0bf267bec1f0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:56:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:56:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'flavor' on Instance uuid d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:56:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-dec9948e-d3eb-46ec-9a8b-922a03012481 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.761s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:55 user nova-compute[73476]: INFO nova.compute.manager [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Terminating instance
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-8aafe79f-3cad-4eff-81de-1540a2684211 req-e263cf8c-30b1-4fbc-8cc0-214814fa06dd service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-unplugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8aafe79f-3cad-4eff-81de-1540a2684211 req-e263cf8c-30b1-4fbc-8cc0-214814fa06dd service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8aafe79f-3cad-4eff-81de-1540a2684211 req-e263cf8c-30b1-4fbc-8cc0-214814fa06dd service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8aafe79f-3cad-4eff-81de-1540a2684211 req-e263cf8c-30b1-4fbc-8cc0-214814fa06dd service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-8aafe79f-3cad-4eff-81de-1540a2684211 req-e263cf8c-30b1-4fbc-8cc0-214814fa06dd service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-unplugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-8aafe79f-3cad-4eff-81de-1540a2684211 req-e263cf8c-30b1-4fbc-8cc0-214814fa06dd service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-unplugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:56:55 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Instance destroyed successfully.
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.objects.instance [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'resources' on Instance uuid ed515d2d-7ad6-48bb-b353-abc4e620156c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-498578521',display_name='tempest-ServerRescueNegativeTestJSON-server-498578521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-498578521',id=24,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrYc/eo42C+qeHxgT+p6TK6jOtky3Pkwr7yvC+k8KAA3Fdpx5iwJgpsdD1am7zb+G0Wb0G2AiVReR/rWqcojnZEmPVzWbjoLQ2gzQtDRr1lW7FV6rEkvFmKMKX03TRu1g==',key_name='tempest-keypair-113143643',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:52:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-63tr0wlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:54:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=ed515d2d-7ad6-48bb-b353-abc4e620156c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "address": "fa:16:3e:df:c4:5d", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c33176d-b0", "ovs_interfaceid": "3c33176d-b04b-4fcd-9e30-e2b9799af0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=3c33176d-b04b-4fcd-9e30-e2b9799af0c4,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33176d-b0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG os_vif [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=3c33176d-b04b-4fcd-9e30-e2b9799af0c4,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33176d-b0') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c33176d-b0, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:56:55 user nova-compute[73476]: INFO os_vif [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=3c33176d-b04b-4fcd-9e30-e2b9799af0c4,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c33176d-b0')
Aug 26 20:56:55 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Deleting instance files /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c_del
Aug 26 20:56:55 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Deletion of /opt/stack/data/nova/instances/ed515d2d-7ad6-48bb-b353-abc4e620156c_del complete
Aug 26 20:56:55 user nova-compute[73476]: INFO nova.compute.manager [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 20:56:55 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:56:55 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-3b961446-b1af-4b13-874a-2824c1ea3467 req-f78c64e9-c5ab-46bb-b886-8b0ddf590cf5 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-deleted-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:57 user nova-compute[73476]: INFO nova.compute.manager [req-3b961446-b1af-4b13-874a-2824c1ea3467 req-f78c64e9-c5ab-46bb-b886-8b0ddf590cf5 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Neutron deleted interface 3c33176d-b04b-4fcd-9e30-e2b9799af0c4; detaching it from the instance and deleting it from the info cache
Aug 26 20:56:57 user nova-compute[73476]: DEBUG nova.network.neutron [req-3b961446-b1af-4b13-874a-2824c1ea3467 req-f78c64e9-c5ab-46bb-b886-8b0ddf590cf5 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-3b961446-b1af-4b13-874a-2824c1ea3467 req-f78c64e9-c5ab-46bb-b886-8b0ddf590cf5 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Detach interface failed, port_id=3c33176d-b04b-4fcd-9e30-e2b9799af0c4, reason: Instance ed515d2d-7ad6-48bb-b353-abc4e620156c could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:56:57 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Took 1.38 seconds to deallocate network for instance.
Aug 26 20:56:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-8bfc37c9-69fd-447e-a5fc-ad486cf09806 req-2bd8d862-05c7-4ba5-9de8-710a6df80a48 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8bfc37c9-69fd-447e-a5fc-ad486cf09806 req-2bd8d862-05c7-4ba5-9de8-710a6df80a48 service nova] Acquiring lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8bfc37c9-69fd-447e-a5fc-ad486cf09806 req-2bd8d862-05c7-4ba5-9de8-710a6df80a48 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8bfc37c9-69fd-447e-a5fc-ad486cf09806 req-2bd8d862-05c7-4ba5-9de8-710a6df80a48 service nova] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-8bfc37c9-69fd-447e-a5fc-ad486cf09806 req-2bd8d862-05c7-4ba5-9de8-710a6df80a48 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] No waiting events found dispatching network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:56:57 user nova-compute[73476]: WARNING nova.compute.manager [req-8bfc37c9-69fd-447e-a5fc-ad486cf09806 req-2bd8d862-05c7-4ba5-9de8-710a6df80a48 service nova] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Received unexpected event network-vif-plugged-3c33176d-b04b-4fcd-9e30-e2b9799af0c4 for instance with vm_state deleted and task_state None.
Aug 26 20:56:57 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:56:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:56:57 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Deleted allocations for instance ed515d2d-7ad6-48bb-b353-abc4e620156c
Aug 26 20:56:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-927c22a9-3cfc-4cae-8d85-203cf742825e tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "ed515d2d-7ad6-48bb-b353-abc4e620156c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.877s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083406.2829306, 762ffba7-912d-40d7-af19-667df1760dc6 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:57:01 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] VM Stopped (Lifecycle Event)
Aug 26 20:57:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-6f820dac-e2ce-49ba-af18-0910a5f74b15 None None] [instance: 762ffba7-912d-40d7-af19-667df1760dc6] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGTYAWzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:57:01 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:57:01 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:57:01 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf673ef-f9b5-4004-b9ed-4a84a73a7aff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:57:01 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[643803c1-ed9f-46bd-a7a6-ff9fc70c7e5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032] added
Aug 26 20:57:01 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e60aa4-5168-4dc0-88e9-8a1bc6451cf3]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[511d332a-5395-4003-bc8f-8ab154048f8b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGTYAWzi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGTYAWzi" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdd3ff7-690c-42aa-a027-14df7073a9e6]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yGTYAWzi'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad4c20b-cbbc-48a2-a90d-756c93ee973a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a98cc77-3562-460a-98b6-b7f00591529f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:01 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:01 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:01 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:01 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a3d705-aec5-44c7-803a-0bfe2e1fd009]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032, portal: 172.16.0.220,3260]
Aug 26 20:57:01 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032, portal: 172.16.0.220,3260] successful.
Aug 26 20:57:01 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[61633464-4a26-456f-b65b-a09b1c704c4e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[268a784c-8dbb-4a30-a670-b48401f10760]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:01 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:01 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:57:01 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:01 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:01 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:57:01 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6746edf-2837-43cc-9098-afae7482c419]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:57:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGTYAWzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:57:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:57:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23061653166343763', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:57:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061653166343763', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:57:02 user nova-compute[73476]: DEBUG nova.objects.instance [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'flavor' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:57:02 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:57:02 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 20:57:02 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:57:02 user nova-compute[73476]:   <serial>6d25776e-2b92-4555-84ca-998d013c2032</serial>
Aug 26 20:57:02 user nova-compute[73476]: </disk>
Aug 26 20:57:02 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:57:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:57:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:57:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] No VIF found with MAC fa:16:3e:04:f8:66, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:57:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-85bb9e17-9c94-4841-828b-a3b8167530ea tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.477s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:04 user nova-compute[73476]: INFO nova.compute.manager [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Rescuing
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquired lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "aae763e2-8571-4c3f-91e3-4cc501b3d335" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:04 user nova-compute[73476]: INFO nova.compute.manager [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Terminating instance
Aug 26 20:57:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:57:04 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Instance destroyed successfully.
Aug 26 20:57:04 user nova-compute[73476]: DEBUG nova.objects.instance [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'resources' on Instance uuid aae763e2-8571-4c3f-91e3-4cc501b3d335 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-275903418',display_name='tempest-ServerActionsTestOtherA-server-275903418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-275903418',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrUMTyGNKdGpzDsrysQPohyAkRqtJhi3sdBZorTU8L/A2dHf0ht3Zah6gdCoAeVQTlLTdvxBfzTJPbHDiEF3xFnMtXTZ/YbW5aEqOqGzGXK2CkdK6c5/YxdHT2BmY6wkQ==',key_name='tempest-keypair-2137585327',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-mljsme95',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:55:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=aae763e2-8571-4c3f-91e3-4cc501b3d335,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "address": "fa:16:3e:fe:cc:bd", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa830ab77-92", "ovs_interfaceid": "a830ab77-92de-4d26-9371-0c133f6d2bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG os_vif [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa830ab77-92, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:57:04 user nova-compute[73476]: INFO os_vif [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:cc:bd,bridge_name='br-int',has_traffic_filtering=True,id=a830ab77-92de-4d26-9371-0c133f6d2bf1,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa830ab77-92')
Aug 26 20:57:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrEXBqAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:57:04 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:57:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5759c38-31d0-4814-b985-f3cdb3f80011', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d481ed6-9a70-4d00-8f8b-bdb7930fc697]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3122fa-ae39-40b8-baf5-0552af371b2d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:05 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:05 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:57:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:05 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:05 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:57:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b0126f80>, {}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Disconnecting from: [] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] <== disconnect_volume: return (58ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:57:05 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Deletion of /opt/stack/data/nova/instances/aae763e2-8571-4c3f-91e3-4cc501b3d335_resize failed
Aug 26 20:57:05 user nova-compute[73476]: INFO nova.compute.manager [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Took 0.18 seconds to destroy the instance on the hypervisor.
Aug 26 20:57:05 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Releasing lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-36aa6109-c807-4634-9b4e-62a318636e95 req-2a80b4a2-85a0-48f4-8f15-5afb747de710 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-36aa6109-c807-4634-9b4e-62a318636e95 req-2a80b4a2-85a0-48f4-8f15-5afb747de710 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-36aa6109-c807-4634-9b4e-62a318636e95 req-2a80b4a2-85a0-48f4-8f15-5afb747de710 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-36aa6109-c807-4634-9b4e-62a318636e95 req-2a80b4a2-85a0-48f4-8f15-5afb747de710 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-36aa6109-c807-4634-9b4e-62a318636e95 req-2a80b4a2-85a0-48f4-8f15-5afb747de710 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:05 user nova-compute[73476]: WARNING nova.compute.manager [req-36aa6109-c807-4634-9b4e-62a318636e95 req-2a80b4a2-85a0-48f4-8f15-5afb747de710 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state active and task_state rescuing.
Aug 26 20:57:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Instance destroyed successfully.
Aug 26 20:57:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Attempting a stable device rescue
Aug 26 20:57:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73476) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 20:57:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Instance directory exists: not creating {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 20:57:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Creating image(s)
Aug 26 20:57:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:06 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "6ea951000b55bf1b5e664f79d66642a9ced55cc1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "6ea951000b55bf1b5e664f79d66642a9ced55cc1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-79c4831a-29bf-453a-abbf-fbb0df02c11b req-8adfef5d-231c-4386-a8a0-61f98a170556 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Received event network-vif-deleted-a830ab77-92de-4d26-9371-0c133f6d2bf1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:07 user nova-compute[73476]: INFO nova.compute.manager [req-79c4831a-29bf-453a-abbf-fbb0df02c11b req-8adfef5d-231c-4386-a8a0-61f98a170556 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Neutron deleted interface a830ab77-92de-4d26-9371-0c133f6d2bf1; detaching it from the instance and deleting it from the info cache
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-79c4831a-29bf-453a-abbf-fbb0df02c11b req-8adfef5d-231c-4386-a8a0-61f98a170556 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:07 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Took 2.14 seconds to deallocate network for instance.
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-79c4831a-29bf-453a-abbf-fbb0df02c11b req-8adfef5d-231c-4386-a8a0-61f98a170556 service nova] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Detach interface failed, port_id=a830ab77-92de-4d26-9371-0c133f6d2bf1, reason: Instance aae763e2-8571-4c3f-91e3-4cc501b3d335 could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:57:07 user nova-compute[73476]: INFO nova.compute.manager [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Took 0.08 seconds to detach 1 volumes for instance.
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Deleting volume: f5759c38-31d0-4814-b985-f3cdb3f80011 {{(pid=73476) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1.part --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.virt.images [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] d9ca251a-da8f-4fcc-a0bc-669977ad7c81 was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1.part /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1.part /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1.converted" returned: 0 in 0.297s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-797965f4-57e9-42ee-8a6b-ba3e209539b0 req-19473039-c3fb-47bf-9884-f6fc2d7c2a03 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-797965f4-57e9-42ee-8a6b-ba3e209539b0 req-19473039-c3fb-47bf-9884-f6fc2d7c2a03 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-797965f4-57e9-42ee-8a6b-ba3e209539b0 req-19473039-c3fb-47bf-9884-f6fc2d7c2a03 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-797965f4-57e9-42ee-8a6b-ba3e209539b0 req-19473039-c3fb-47bf-9884-f6fc2d7c2a03 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-797965f4-57e9-42ee-8a6b-ba3e209539b0 req-19473039-c3fb-47bf-9884-f6fc2d7c2a03 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:07 user nova-compute[73476]: WARNING nova.compute.manager [req-797965f4-57e9-42ee-8a6b-ba3e209539b0 req-19473039-c3fb-47bf-9884-f6fc2d7c2a03 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state active and task_state rescuing.
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "6ea951000b55bf1b5e664f79d66642a9ced55cc1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.634s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "6ea951000b55bf1b5e664f79d66642a9ced55cc1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "6ea951000b55bf1b5e664f79d66642a9ced55cc1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:57:07 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1 --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1,backing_fmt=raw /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:08 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Deleted allocations for instance aae763e2-8571-4c3f-91e3-4cc501b3d335
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1,backing_fmt=raw /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue" returned: 0 in 0.056s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "6ea951000b55bf1b5e664f79d66642a9ced55cc1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'migration_context' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Object Instance<8e964b8e-c28a-4f58-ad0e-d34212a36e42> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Start _get_guest_xml network_info=[{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "vif_mac": "fa:16:3e:04:f8:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd9ca251a-da8f-4fcc-a0bc-669977ad7c81', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '6217d238-8cb2-441f-8ade-c1493031899b', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGTYAWzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8e964b8e-c28a-4f58-ad0e-d34212a36e42', 'attached_at': '', 'detached_at': '', 'volume_id': '6d25776e-2b92-4555-84ca-998d013c2032', 'serial': '6d25776e-2b92-4555-84ca-998d013c2032'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'resources' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Object Instance<8e964b8e-c28a-4f58-ad0e-d34212a36e42> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Object Instance<8e964b8e-c28a-4f58-ad0e-d34212a36e42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:57:08 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:57:08 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-ff250b03-d639-4890-833f-163895996039 tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "aae763e2-8571-4c3f-91e3-4cc501b3d335" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.288s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Object Instance<8e964b8e-c28a-4f58-ad0e-d34212a36e42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGTYAWzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:57:08 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:57:08 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:57:08 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[603c34ce-1499-4cbc-82a2-6f273029621a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yGTYAWzi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 20:57:08 user nova-compute[73476]: node.name = iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032
Aug 26 20:57:08 user nova-compute[73476]: node.tpgt = -1
Aug 26 20:57:08 user nova-compute[73476]: node.startup = automatic
Aug 26 20:57:08 user nova-compute[73476]: node.leading_login = No
Aug 26 20:57:08 user nova-compute[73476]: iface.iscsi_ifacename = default
Aug 26 20:57:08 user nova-compute[73476]: iface.net_ifacename = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.ipaddress = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.prefix_len = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.hwaddress = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.transport_name = tcp
Aug 26 20:57:08 user nova-compute[73476]: iface.initiatorname = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.state = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.vlan_id = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.vlan_priority = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.vlan_state = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.iface_num = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.mtu = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.port = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.bootproto = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.subnet_mask = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.gateway = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.dhcp_alt_client_id = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.dhcp_dns = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.dhcp_learn_iqn = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.dhcp_vendor_id_state = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.dhcp_vendor_id = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.dhcp_slp_da = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.fragmentation = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.gratuitous_arp = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.incoming_forwarding = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.tos_state = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.tos = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.ttl = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.delayed_ack = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.tcp_nagle = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.tcp_wsf_state = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.tcp_wsf = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.tcp_timer_scale = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.tcp_timestamp = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.redirect = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.def_task_mgmt_timeout = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.header_digest = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.data_digest = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.immediate_data = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.initial_r2t = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.data_seq_inorder = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.data_pdu_inorder = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.erl = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.max_receive_data_len = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.first_burst_len = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.max_outstanding_r2t = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.max_burst_len = 0
Aug 26 20:57:08 user nova-compute[73476]: iface.chap_auth = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.bidi_chap = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.strict_login_compliance = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.discovery_auth = <empty>
Aug 26 20:57:08 user nova-compute[73476]: iface.discovery_logout = <empty>
Aug 26 20:57:08 user nova-compute[73476]: node.discovery_address = <empty>
Aug 26 20:57:08 user nova-compute[73476]: node.discovery_port = 0
Aug 26 20:57:08 user nova-compute[73476]: node.discovery_type = static
Aug 26 20:57:08 user nova-compute[73476]: node.session.initial_cmdsn = 0
Aug 26 20:57:08 user nova-compute[73476]: node.session.initial_login_retry_max = 8
Aug 26 20:57:08 user nova-compute[73476]: node.session.xmit_thread_priority = -20
Aug 26 20:57:08 user nova-compute[73476]: node.session.cmds_max = 128
Aug 26 20:57:08 user nova-compute[73476]: node.session.queue_depth = 32
Aug 26 20:57:08 user nova-compute[73476]: node.session.nr_sessions = 1
Aug 26 20:57:08 user nova-compute[73476]: node.session.auth.authmethod = CHAP
Aug 26 20:57:08 user nova-compute[73476]: node.session.auth.username = yGTYAWzi
Aug 26 20:57:08 user nova-compute[73476]: node.session.auth.password = ***
Aug 26 20:57:08 user nova-compute[73476]: node.session.auth.username_in = <empty>
Aug 26 20:57:08 user nova-compute[73476]: node.session.auth.password_in = <empty>
Aug 26 20:57:08 user nova-compute[73476]: node.session.auth.chap_algs = MD5
Aug 26 20:57:08 user nova-compute[73476]: node.session.timeo.replacement_timeout = 120
Aug 26 20:57:08 user nova-compute[73476]: node.session.err_timeo.abort_timeout = 15
Aug 26 20:57:08 user nova-compute[73476]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 20:57:08 user nova-compute[73476]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 20:57:08 user nova-compute[73476]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.FastAbort = Yes
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.InitialR2T = No
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.ImmediateData = Yes
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.MaxConnections = 1
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 20:57:08 user nova-compute[73476]: node.session.iscsi.ERL = 0
Aug 26 20:57:08 user nova-compute[73476]: node.session.scan = manual
Aug 26 20:57:08 user nova-compute[73476]: node.session.reopen_max = 0
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].address = 172.16.0.220
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].port = 3260
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].startup = manual
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].tcp.window_size = 524288
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].tcp.type_of_service = 0
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].timeo.logout_timeout = 15
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].timeo.login_timeout = 15
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].timeo.auth_timeout = 45
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].iscsi.DataDigest = None
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].iscsi.IFMarker = No
Aug 26 20:57:08 user nova-compute[73476]: node.conn[0].iscsi.OFMarker = No
Aug 26 20:57:08 user nova-compute[73476]: # END RECORD
Aug 26 20:57:08 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f6401a-e33d-4f5b-aed2-9f11b62b35d7]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8477acc8-9ac3-4028-b95a-ef663134ffc2]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGTYAWzi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGTYAWzi" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c0e3f4-68ad-4b2d-b820-40163210c2eb]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yGTYAWzi'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db7940-9b89-42d8-b363-ea87fc3bf403]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21d80be-5cad-4777-b75f-8f084d5b2c01]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:08 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:08 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:57:08 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:08 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:08 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:57:08 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] HCTL ('34', '0', '0', 0) found on session 39 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e084b39b-bee1-4efe-ae89-44c5db4513da]: (4, ('0 0 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Searching for a device in session 39 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGTYAWzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.165s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '23061653166343763', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061653166343763', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1499031467',display_name='tempest-ServerStableDeviceRescueTest-server-1499031467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1499031467',id=28,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDawYycI76NkUKDRLbP9/BjRPLtgnBqjfQHAVSnC1A7iy3vv3tmWNE5+ydF0i5dZv7RrDZE5nZ7ua+6pZvputBnQRMIV1Od9pG1QQu6/dSZ8ykQv+vGnHBn6EvuJACGwCA==',key_name='tempest-keypair-1844255857',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:53:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8203758c21c944a3b6412f96d7e55246',ramdisk_id='',reservation_id='r-4bx0u0o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1046559965',owner_user_name='tempest-ServerStableDeviceRescueTest-1046559965-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:54:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d92c80cbcec44e1db0b0838e2574222a',uuid=8e964b8e-c28a-4f58-ad0e-d34212a36e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "vif_mac": "fa:16:3e:04:f8:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Converting VIF {"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "vif_mac": "fa:16:3e:04:f8:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:f8:66,bridge_name='br-int',has_traffic_filtering=True,id=4fbe332d-e987-48c7-9ddf-94e0e0427864,network=Network(fb47d1e5-3099-46c3-8c85-029b18700b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbe332d-e9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.objects.base [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Object Instance<8e964b8e-c28a-4f58-ad0e-d34212a36e42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:57:08 user nova-compute[73476]:   <uuid>8e964b8e-c28a-4f58-ad0e-d34212a36e42</uuid>
Aug 26 20:57:08 user nova-compute[73476]:   <name>instance-0000001c</name>
Aug 26 20:57:08 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:57:08 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:57:08 user nova-compute[73476]:   <metadata>
Aug 26 20:57:08 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:57:08 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:57:08 user nova-compute[73476]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1499031467</nova:name>
Aug 26 20:57:08 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:57:08</nova:creationTime>
Aug 26 20:57:08 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:57:08 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:57:08 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:57:08 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:57:08 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:57:08 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:57:08 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:57:08 user nova-compute[73476]:       <nova:owner>
Aug 26 20:57:08 user nova-compute[73476]:         <nova:user uuid="d92c80cbcec44e1db0b0838e2574222a">tempest-ServerStableDeviceRescueTest-1046559965-project-member</nova:user>
Aug 26 20:57:08 user nova-compute[73476]:         <nova:project uuid="8203758c21c944a3b6412f96d7e55246">tempest-ServerStableDeviceRescueTest-1046559965</nova:project>
Aug 26 20:57:08 user nova-compute[73476]:       </nova:owner>
Aug 26 20:57:08 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:57:08 user nova-compute[73476]:       <nova:ports>
Aug 26 20:57:08 user nova-compute[73476]:         <nova:port uuid="4fbe332d-e987-48c7-9ddf-94e0e0427864">
Aug 26 20:57:08 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 20:57:08 user nova-compute[73476]:         </nova:port>
Aug 26 20:57:08 user nova-compute[73476]:       </nova:ports>
Aug 26 20:57:08 user nova-compute[73476]:     </nova:instance>
Aug 26 20:57:08 user nova-compute[73476]:   </metadata>
Aug 26 20:57:08 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:57:08 user nova-compute[73476]:     <system>
Aug 26 20:57:08 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:57:08 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:57:08 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:57:08 user nova-compute[73476]:       <entry name="serial">8e964b8e-c28a-4f58-ad0e-d34212a36e42</entry>
Aug 26 20:57:08 user nova-compute[73476]:       <entry name="uuid">8e964b8e-c28a-4f58-ad0e-d34212a36e42</entry>
Aug 26 20:57:08 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:57:08 user nova-compute[73476]:     </system>
Aug 26 20:57:08 user nova-compute[73476]:   </sysinfo>
Aug 26 20:57:08 user nova-compute[73476]:   <os>
Aug 26 20:57:08 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:57:08 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:57:08 user nova-compute[73476]:   </os>
Aug 26 20:57:08 user nova-compute[73476]:   <features>
Aug 26 20:57:08 user nova-compute[73476]:     <acpi/>
Aug 26 20:57:08 user nova-compute[73476]:     <apic/>
Aug 26 20:57:08 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:57:08 user nova-compute[73476]:   </features>
Aug 26 20:57:08 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:57:08 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:57:08 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:57:08 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:57:08 user nova-compute[73476]:   </clock>
Aug 26 20:57:08 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:57:08 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:57:08 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:57:08 user nova-compute[73476]:   </cpu>
Aug 26 20:57:08 user nova-compute[73476]:   <devices>
Aug 26 20:57:08 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:57:08 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:57:08 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk"/>
Aug 26 20:57:08 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:57:08 user nova-compute[73476]:     </disk>
Aug 26 20:57:08 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:57:08 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:57:08 user nova-compute[73476]:       <source dev="/dev/sdc"/>
Aug 26 20:57:08 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 20:57:08 user nova-compute[73476]:       <serial>6d25776e-2b92-4555-84ca-998d013c2032</serial>
Aug 26 20:57:08 user nova-compute[73476]:     </disk>
Aug 26 20:57:08 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:57:08 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:57:08 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue"/>
Aug 26 20:57:08 user nova-compute[73476]:       <target dev="vdc" bus="virtio"/>
Aug 26 20:57:08 user nova-compute[73476]:       <boot order="1"/>
Aug 26 20:57:08 user nova-compute[73476]:     </disk>
Aug 26 20:57:08 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:57:08 user nova-compute[73476]:       <mac address="fa:16:3e:04:f8:66"/>
Aug 26 20:57:08 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:57:08 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:57:08 user nova-compute[73476]:       <target dev="tap4fbe332d-e9"/>
Aug 26 20:57:08 user nova-compute[73476]:     </interface>
Aug 26 20:57:08 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:57:08 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/console.log" append="off"/>
Aug 26 20:57:08 user nova-compute[73476]:     </serial>
Aug 26 20:57:08 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:57:08 user nova-compute[73476]:     <video>
Aug 26 20:57:08 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:57:08 user nova-compute[73476]:     </video>
Aug 26 20:57:08 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:57:08 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:57:08 user nova-compute[73476]:     </rng>
Aug 26 20:57:08 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:57:08 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:57:08 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:57:08 user nova-compute[73476]:     </memballoon>
Aug 26 20:57:08 user nova-compute[73476]:   </devices>
Aug 26 20:57:08 user nova-compute[73476]: </domain>
Aug 26 20:57:08 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:57:08 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Instance destroyed successfully.
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:57:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] No VIF found with MAC fa:16:3e:04:f8:66, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:57:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-77b1dae9-60dd-48e2-a587-e38f5d504704 req-bff426f1-1a2a-4978-9450-19b0b728fa31 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-77b1dae9-60dd-48e2-a587-e38f5d504704 req-bff426f1-1a2a-4978-9450-19b0b728fa31 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-77b1dae9-60dd-48e2-a587-e38f5d504704 req-bff426f1-1a2a-4978-9450-19b0b728fa31 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-77b1dae9-60dd-48e2-a587-e38f5d504704 req-bff426f1-1a2a-4978-9450-19b0b728fa31 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-77b1dae9-60dd-48e2-a587-e38f5d504704 req-bff426f1-1a2a-4978-9450-19b0b728fa31 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:10 user nova-compute[73476]: WARNING nova.compute.manager [req-77b1dae9-60dd-48e2-a587-e38f5d504704 req-bff426f1-1a2a-4978-9450-19b0b728fa31 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state active and task_state rescuing.
Aug 26 20:57:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083415.859184, ed515d2d-7ad6-48bb-b353-abc4e620156c => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:57:10 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] VM Stopped (Lifecycle Event)
Aug 26 20:57:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f3a6efc0-87d5-433d-9814-c0ad252be4da None None] [instance: ed515d2d-7ad6-48bb-b353-abc4e620156c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4fe8b003-4c3f-4434-a07d-fdbf4a9d09d7 req-cced6d13-d9dd-4ad5-8a24-e3e51ec1d678 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4fe8b003-4c3f-4434-a07d-fdbf4a9d09d7 req-cced6d13-d9dd-4ad5-8a24-e3e51ec1d678 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4fe8b003-4c3f-4434-a07d-fdbf4a9d09d7 req-cced6d13-d9dd-4ad5-8a24-e3e51ec1d678 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4fe8b003-4c3f-4434-a07d-fdbf4a9d09d7 req-cced6d13-d9dd-4ad5-8a24-e3e51ec1d678 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-4fe8b003-4c3f-4434-a07d-fdbf4a9d09d7 req-cced6d13-d9dd-4ad5-8a24-e3e51ec1d678 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:12 user nova-compute[73476]: WARNING nova.compute.manager [req-4fe8b003-4c3f-4434-a07d-fdbf4a9d09d7 req-cced6d13-d9dd-4ad5-8a24-e3e51ec1d678 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state active and task_state rescuing.
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for 8e964b8e-c28a-4f58-ad0e-d34212a36e42 due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083432.4817185, 8e964b8e-c28a-4f58-ad0e-d34212a36e42 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:57:12 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] VM Resumed (Lifecycle Event)
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d47af03d-dbb8-418f-a32d-d8e9a3e1d05c tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:57:12 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083432.4846668, 8e964b8e-c28a-4f58-ad0e-d34212a36e42 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:57:12 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] VM Started (Lifecycle Event)
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:57:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "a015ae4b-1bc1-4748-839f-7a380bd002d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:26 user nova-compute[73476]: INFO nova.compute.manager [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Terminating instance
Aug 26 20:57:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-4beefd8a-9ff6-43cc-be31-858be10d0a13 req-2c9310cb-d7d8-42df-af8f-5b1193796e8a service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received event network-vif-unplugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4beefd8a-9ff6-43cc-be31-858be10d0a13 req-2c9310cb-d7d8-42df-af8f-5b1193796e8a service nova] Acquiring lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4beefd8a-9ff6-43cc-be31-858be10d0a13 req-2c9310cb-d7d8-42df-af8f-5b1193796e8a service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4beefd8a-9ff6-43cc-be31-858be10d0a13 req-2c9310cb-d7d8-42df-af8f-5b1193796e8a service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-4beefd8a-9ff6-43cc-be31-858be10d0a13 req-2c9310cb-d7d8-42df-af8f-5b1193796e8a service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] No waiting events found dispatching network-vif-unplugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-4beefd8a-9ff6-43cc-be31-858be10d0a13 req-2c9310cb-d7d8-42df-af8f-5b1193796e8a service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received event network-vif-unplugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Instance destroyed successfully.
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.objects.instance [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lazy-loading 'resources' on Instance uuid a015ae4b-1bc1-4748-839f-7a380bd002d9 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-43705332',display_name='tempest-VolumesActionsTest-instance-43705332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-43705332',id=34,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:55:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='166fe05519d74dd78e3228e47ef09e90',ramdisk_id='',reservation_id='r-8cmb3aik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-562295190',owner_user_name='tempest-VolumesActionsTest-562295190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:55:43Z,user_data=None,user_id='d38f2a23de67450a825596c77fe9dbf2',uuid=a015ae4b-1bc1-4748-839f-7a380bd002d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converting VIF {"id": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "address": "fa:16:3e:8e:7d:8f", "network": {"id": "e8cfa05f-96a2-4235-b079-d7cab68bde98", "bridge": "br-int", "label": "tempest-VolumesActionsTest-159854612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166fe05519d74dd78e3228e47ef09e90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55361d2-55", "ovs_interfaceid": "f55361d2-5582-45c5-a7f0-d679b9a04ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=f55361d2-5582-45c5-a7f0-d679b9a04ba8,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55361d2-55') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG os_vif [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=f55361d2-5582-45c5-a7f0-d679b9a04ba8,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55361d2-55') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf55361d2-55, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:57:27 user nova-compute[73476]: INFO os_vif [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:8f,bridge_name='br-int',has_traffic_filtering=True,id=f55361d2-5582-45c5-a7f0-d679b9a04ba8,network=Network(e8cfa05f-96a2-4235-b079-d7cab68bde98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf55361d2-55')
Aug 26 20:57:27 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Deleting instance files /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9_del
Aug 26 20:57:27 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Deletion of /opt/stack/data/nova/instances/a015ae4b-1bc1-4748-839f-7a380bd002d9_del complete
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: INFO nova.compute.manager [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 26 20:57:27 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:27 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Took 0.58 seconds to deallocate network for instance.
Aug 26 20:57:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-674e0c70-9777-46ab-87f0-f9059540d971 req-cc6185bc-4e7e-414f-832e-acb61a63d8d3 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received event network-vif-deleted-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:28 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:57:28 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:57:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:28 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Deleted allocations for instance a015ae4b-1bc1-4748-839f-7a380bd002d9
Aug 26 20:57:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-94f033a2-0e50-4a0c-ab41-b3f9ec76a0f0 tempest-VolumesActionsTest-562295190 tempest-VolumesActionsTest-562295190-project-member] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] Acquiring lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] No waiting events found dispatching network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:29 user nova-compute[73476]: WARNING nova.compute.manager [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received unexpected event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 for instance with vm_state deleted and task_state None.
Aug 26 20:57:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] Acquiring lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] No waiting events found dispatching network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:29 user nova-compute[73476]: WARNING nova.compute.manager [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received unexpected event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 for instance with vm_state deleted and task_state None.
Aug 26 20:57:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] Acquiring lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] Lock "a015ae4b-1bc1-4748-839f-7a380bd002d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] No waiting events found dispatching network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:29 user nova-compute[73476]: WARNING nova.compute.manager [req-1654db49-99cd-49a6-a6a0-abeb8fe5b19d req-3949e182-9ac4-4084-a041-cfeab8a1d4b1 service nova] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Received unexpected event network-vif-plugged-f55361d2-5582-45c5-a7f0-d679b9a04ba8 for instance with vm_state deleted and task_state None.
Aug 26 20:57:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:32 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:33 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:34 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:34 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:57:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73476) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:57:39 user nova-compute[73476]: INFO nova.compute.claims [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Claim successful on node user
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:39 user nova-compute[73476]: INFO nova.compute.manager [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Unshelving
Aug 26 20:57:39 user nova-compute[73476]: INFO nova.virt.block_device [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Booting with volume 3f779043-76ba-4ff7-bc82-066e88836227 at /dev/vdc
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG os_brick.utils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b84ca80-8fce-4596-8595-4bbe910c552f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b08d389-1e9b-4db4-b836-64418bbad0a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:39 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5171108b-4cdd-4369-901b-7058a823003a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[93439e72-fe49-4d73-b1ed-e21fcc63acc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:57:39 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55ceffe-df2c-4e51-92da-f212292d05fe]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG os_brick.utils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating existing volume attachment record: 1534145a-011e-4472-bcd0-f7e67ef8e320 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.policy [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecd8ed063c144eb694017e5750ee57a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98519bcea11642e6b491b3a0cb4616db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:57:39 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Creating image(s)
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "/opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "/opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "/opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.220s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk 1073741824" returned: 0 in 0.056s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Successfully created port: 391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Cannot resize image /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Ensure instance console log exists: /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Successfully updated port: 391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "refresh_cache-267a25c3-a5ab-4772-add0-33b854a44c23" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquired lock "refresh_cache-267a25c3-a5ab-4772-add0-33b854a44c23" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-956fad68-6f9f-4a0d-8125-8928ff272726 req-0eaa00dd-425c-408f-851c-9a61264df81c service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received event network-changed-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.compute.manager [req-956fad68-6f9f-4a0d-8125-8928ff272726 req-0eaa00dd-425c-408f-851c-9a61264df81c service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Refreshing instance network info cache due to event network-changed-391ff021-f70e-4a2d-99dc-554838d9a3c1. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-956fad68-6f9f-4a0d-8125-8928ff272726 req-0eaa00dd-425c-408f-851c-9a61264df81c service nova] Acquiring lock "refresh_cache-267a25c3-a5ab-4772-add0-33b854a44c23" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Updating instance_info_cache with network_info: [{"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Releasing lock "refresh_cache-267a25c3-a5ab-4772-add0-33b854a44c23" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Instance network_info: |[{"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-956fad68-6f9f-4a0d-8125-8928ff272726 req-0eaa00dd-425c-408f-851c-9a61264df81c service nova] Acquired lock "refresh_cache-267a25c3-a5ab-4772-add0-33b854a44c23" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.network.neutron [req-956fad68-6f9f-4a0d-8125-8928ff272726 req-0eaa00dd-425c-408f-851c-9a61264df81c service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Refreshing network info cache for port 391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Start _get_guest_xml network_info=[{"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:57:41 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:57:41 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-460471589',display_name='tempest-AttachVolumeNegativeTest-server-460471589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-460471589',id=35,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK/YKMn5DCyucDgLctxtgKDkiILiQRgiT3jJ8z5v3jarrdvmn1SST4I2wphTX/pLT7YW1ZLLB6ZqPZZIb3MY3tOtJNKMheZWYc4+zJjjKUxRUBFbDHr42GZKxutBQUe/Q==',key_name='tempest-keypair-487381580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-wmlnvkcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=267a25c3-a5ab-4772-add0-33b854a44c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ab:61,bridge_name='br-int',has_traffic_filtering=True,id=391ff021-f70e-4a2d-99dc-554838d9a3c1,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ff021-f7') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.objects.instance [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'pci_devices' on Instance uuid 267a25c3-a5ab-4772-add0-33b854a44c23 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:57:41 user nova-compute[73476]:   <uuid>267a25c3-a5ab-4772-add0-33b854a44c23</uuid>
Aug 26 20:57:41 user nova-compute[73476]:   <name>instance-00000023</name>
Aug 26 20:57:41 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:57:41 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:57:41 user nova-compute[73476]:   <metadata>
Aug 26 20:57:41 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:57:41 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:57:41 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeNegativeTest-server-460471589</nova:name>
Aug 26 20:57:41 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:57:41</nova:creationTime>
Aug 26 20:57:41 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:57:41 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:57:41 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:57:41 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:57:41 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:57:41 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:57:41 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:57:41 user nova-compute[73476]:       <nova:owner>
Aug 26 20:57:41 user nova-compute[73476]:         <nova:user uuid="ecd8ed063c144eb694017e5750ee57a9">tempest-AttachVolumeNegativeTest-745835648-project-member</nova:user>
Aug 26 20:57:41 user nova-compute[73476]:         <nova:project uuid="98519bcea11642e6b491b3a0cb4616db">tempest-AttachVolumeNegativeTest-745835648</nova:project>
Aug 26 20:57:41 user nova-compute[73476]:       </nova:owner>
Aug 26 20:57:41 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:57:41 user nova-compute[73476]:       <nova:ports>
Aug 26 20:57:41 user nova-compute[73476]:         <nova:port uuid="391ff021-f70e-4a2d-99dc-554838d9a3c1">
Aug 26 20:57:41 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 20:57:41 user nova-compute[73476]:         </nova:port>
Aug 26 20:57:41 user nova-compute[73476]:       </nova:ports>
Aug 26 20:57:41 user nova-compute[73476]:     </nova:instance>
Aug 26 20:57:41 user nova-compute[73476]:   </metadata>
Aug 26 20:57:41 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:57:41 user nova-compute[73476]:     <system>
Aug 26 20:57:41 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:57:41 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:57:41 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:57:41 user nova-compute[73476]:       <entry name="serial">267a25c3-a5ab-4772-add0-33b854a44c23</entry>
Aug 26 20:57:41 user nova-compute[73476]:       <entry name="uuid">267a25c3-a5ab-4772-add0-33b854a44c23</entry>
Aug 26 20:57:41 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:57:41 user nova-compute[73476]:     </system>
Aug 26 20:57:41 user nova-compute[73476]:   </sysinfo>
Aug 26 20:57:41 user nova-compute[73476]:   <os>
Aug 26 20:57:41 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:57:41 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:57:41 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:57:41 user nova-compute[73476]:   </os>
Aug 26 20:57:41 user nova-compute[73476]:   <features>
Aug 26 20:57:41 user nova-compute[73476]:     <acpi/>
Aug 26 20:57:41 user nova-compute[73476]:     <apic/>
Aug 26 20:57:41 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:57:41 user nova-compute[73476]:   </features>
Aug 26 20:57:41 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:57:41 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:57:41 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:57:41 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:57:41 user nova-compute[73476]:   </clock>
Aug 26 20:57:41 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:57:41 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:57:41 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:57:41 user nova-compute[73476]:   </cpu>
Aug 26 20:57:41 user nova-compute[73476]:   <devices>
Aug 26 20:57:41 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:57:41 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:57:41 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk"/>
Aug 26 20:57:41 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:57:41 user nova-compute[73476]:     </disk>
Aug 26 20:57:41 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:57:41 user nova-compute[73476]:       <mac address="fa:16:3e:b9:ab:61"/>
Aug 26 20:57:41 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:57:41 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:57:41 user nova-compute[73476]:       <target dev="tap391ff021-f7"/>
Aug 26 20:57:41 user nova-compute[73476]:     </interface>
Aug 26 20:57:41 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:57:41 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/console.log" append="off"/>
Aug 26 20:57:41 user nova-compute[73476]:     </serial>
Aug 26 20:57:41 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:57:41 user nova-compute[73476]:     <video>
Aug 26 20:57:41 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:57:41 user nova-compute[73476]:     </video>
Aug 26 20:57:41 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:57:41 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:57:41 user nova-compute[73476]:     </rng>
Aug 26 20:57:41 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:57:41 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:57:41 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:57:41 user nova-compute[73476]:     </memballoon>
Aug 26 20:57:41 user nova-compute[73476]:   </devices>
Aug 26 20:57:41 user nova-compute[73476]: </domain>
Aug 26 20:57:41 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-460471589',display_name='tempest-AttachVolumeNegativeTest-server-460471589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-460471589',id=35,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK/YKMn5DCyucDgLctxtgKDkiILiQRgiT3jJ8z5v3jarrdvmn1SST4I2wphTX/pLT7YW1ZLLB6ZqPZZIb3MY3tOtJNKMheZWYc4+zJjjKUxRUBFbDHr42GZKxutBQUe/Q==',key_name='tempest-keypair-487381580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-wmlnvkcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=267a25c3-a5ab-4772-add0-33b854a44c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ab:61,bridge_name='br-int',has_traffic_filtering=True,id=391ff021-f70e-4a2d-99dc-554838d9a3c1,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ff021-f7') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG os_vif [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ab:61,bridge_name='br-int',has_traffic_filtering=True,id=391ff021-f70e-4a2d-99dc-554838d9a3c1,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ff021-f7') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap391ff021-f7, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap391ff021-f7, col_values=(('external_ids', {'iface-id': '391ff021-f70e-4a2d-99dc-554838d9a3c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:ab:61', 'vm-uuid': '267a25c3-a5ab-4772-add0-33b854a44c23'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:41 user nova-compute[73476]: INFO os_vif [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ab:61,bridge_name='br-int',has_traffic_filtering=True,id=391ff021-f70e-4a2d-99dc-554838d9a3c1,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ff021-f7')
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:57:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No VIF found with MAC fa:16:3e:b9:ab:61, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083447.268849, a015ae4b-1bc1-4748-839f-7a380bd002d9 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:57:42 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] VM Stopped (Lifecycle Event)
Aug 26 20:57:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-79e156f6-dfd1-4cd2-96a0-9fa277b6d38e None None] [instance: a015ae4b-1bc1-4748-839f-7a380bd002d9] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:42 user nova-compute[73476]: INFO nova.compute.manager [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Terminating instance
Aug 26 20:57:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG nova.network.neutron [req-956fad68-6f9f-4a0d-8125-8928ff272726 req-0eaa00dd-425c-408f-851c-9a61264df81c service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Updated VIF entry in instance network info cache for port 391ff021-f70e-4a2d-99dc-554838d9a3c1. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG nova.network.neutron [req-956fad68-6f9f-4a0d-8125-8928ff272726 req-0eaa00dd-425c-408f-851c-9a61264df81c service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Updating instance_info_cache with network_info: [{"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-956fad68-6f9f-4a0d-8125-8928ff272726 req-0eaa00dd-425c-408f-851c-9a61264df81c service nova] Releasing lock "refresh_cache-267a25c3-a5ab-4772-add0-33b854a44c23" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:42 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-unplugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] No waiting events found dispatching network-vif-unplugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-unplugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] Acquiring lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] No waiting events found dispatching network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:43 user nova-compute[73476]: WARNING nova.compute.manager [req-53fa2349-324e-42bd-935b-d10d451752ec req-6b7c1c78-5db7-4ac9-bbee-d1866ce7e9ed service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received unexpected event network-vif-plugged-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 for instance with vm_state active and task_state deleting.
Aug 26 20:57:43 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Instance destroyed successfully.
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.objects.instance [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lazy-loading 'resources' on Instance uuid d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-700244707',display_name='tempest-TestMinimumBasicScenario-server-700244707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-700244707',id=26,image_ref='645d413e-b0aa-48ea-8f77-6a0ab2fd809d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNjFbkYrxENkDzGpIFk6wJAxo8Wr5yaLnE97Q9eDlCG8qiNOyPsVTHQdiTnq3oFuv7VNLvgUBazCv9lKIt1eTovozcK1vTIu8XfDKc74313fAOcknwPDyg39N4d6zBaEQ==',key_name='tempest-TestMinimumBasicScenario-1681480724',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:52:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c0bf9d46b5447a495d0cf45071e0c27',ramdisk_id='',reservation_id='r-4efvn902',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='645d413e-b0aa-48ea-8f77-6a0ab2fd809d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1097465264',owner_user_name='tempest-TestMinimumBasicScenario-1097465264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:55:00Z,user_data=None,user_id='818cdd5f2ecf42739eb1d1d44c2d78e5',uuid=d40cfba2-b7b6-4e80-947d-7d7dc031b2a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converting VIF {"id": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "address": "fa:16:3e:e5:38:1d", "network": {"id": "06cfbcaf-e621-4628-aa45-f38ae76ed93b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-132374719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c0bf9d46b5447a495d0cf45071e0c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfeb0f7e-f5", "ovs_interfaceid": "bfeb0f7e-f5b7-497e-a0f4-75d7b5263923", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:38:1d,bridge_name='br-int',has_traffic_filtering=True,id=bfeb0f7e-f5b7-497e-a0f4-75d7b5263923,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeb0f7e-f5') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG os_vif [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:38:1d,bridge_name='br-int',has_traffic_filtering=True,id=bfeb0f7e-f5b7-497e-a0f4-75d7b5263923,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeb0f7e-f5') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfeb0f7e-f5, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:43 user nova-compute[73476]: INFO os_vif [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:38:1d,bridge_name='br-int',has_traffic_filtering=True,id=bfeb0f7e-f5b7-497e-a0f4-75d7b5263923,network=Network(06cfbcaf-e621-4628-aa45-f38ae76ed93b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfeb0f7e-f5')
Aug 26 20:57:43 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Deleting instance files /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5_del
Aug 26 20:57:43 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Deletion of /opt/stack/data/nova/instances/d40cfba2-b7b6-4e80-947d-7d7dc031b2a5_del complete
Aug 26 20:57:43 user nova-compute[73476]: INFO nova.compute.manager [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 26 20:57:43 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:57:43 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:44 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Took 0.90 seconds to deallocate network for instance.
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Refreshing inventories for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Updating ProviderTree inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Refreshing aggregate associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, aggregates: None {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Refreshing trait associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:57:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.688s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:45 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Deleted allocations for instance d40cfba2-b7b6-4e80-947d-7d7dc031b2a5
Aug 26 20:57:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c811c378-03cc-4c40-98a5-163b36a10f68 tempest-TestMinimumBasicScenario-1097465264 tempest-TestMinimumBasicScenario-1097465264-project-member] Lock "d40cfba2-b7b6-4e80-947d-7d7dc031b2a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.080s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received event network-vif-plugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] No waiting events found dispatching network-vif-plugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:45 user nova-compute[73476]: WARNING nova.compute.manager [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received unexpected event network-vif-plugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 for instance with vm_state building and task_state spawning.
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received event network-vif-plugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] No waiting events found dispatching network-vif-plugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:57:45 user nova-compute[73476]: WARNING nova.compute.manager [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received unexpected event network-vif-plugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 for instance with vm_state building and task_state spawning.
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9fdbcdc8-9295-4467-8ae1-0956abcf99bf req-57ba2349-497a-4335-a701-1e8a1a55d3f4 service nova] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Received event network-vif-deleted-bfeb0f7e-f5b7-497e-a0f4-75d7b5263923 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083465.740653, 267a25c3-a5ab-4772-add0-33b854a44c23 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:57:45 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] VM Resumed (Lifecycle Event)
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:45 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Instance spawned successfully.
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 20:57:45 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083465.7411146, 267a25c3-a5ab-4772-add0-33b854a44c23 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:57:45 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] VM Started (Lifecycle Event)
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:57:45 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:57:45 user nova-compute[73476]: INFO nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 26 20:57:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:57:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:46 user nova-compute[73476]: INFO nova.compute.manager [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Took 7.21 seconds to build instance.
Aug 26 20:57:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b07f698c-d8d2-4bff-9912-4cab891f97a7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.338s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:57:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=24.86084747314453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 215be88c-8470-453f-b293-ce98148be308 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 13e8971f-2d6c-4f8e-b895-411db3554e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1dddc689-a053-46d4-a29e-52c8fe78c76d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8644e702-6fc8-4c84-a208-ef9a78cda0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 267a25c3-a5ab-4772-add0-33b854a44c23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:57:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:57:49 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:57:49 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:57:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:57:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:49 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 20:57:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] There are 1 instances to clean {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 20:57:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Instance has had 1 of 5 cleanup attempts {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11142}}
Aug 26 20:57:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Deleting instance files /opt/stack/data/nova/instances/aae763e2-8571-4c3f-91e3-4cc501b3d335_del
Aug 26 20:57:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: aae763e2-8571-4c3f-91e3-4cc501b3d335] Deletion of /opt/stack/data/nova/instances/aae763e2-8571-4c3f-91e3-4cc501b3d335_del complete
Aug 26 20:57:49 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:57:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:57:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:57:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:57:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:57:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Updating instance_info_cache with network_info: [{"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-215be88c-8470-453f-b293-ce98148be308" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:57:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:57:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'pci_requests' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'numa_topology' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:52 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:57:52 user nova-compute[73476]: INFO nova.compute.claims [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Claim successful on node user
Aug 26 20:57:52 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:57:52 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:57:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:52 user nova-compute[73476]: INFO nova.network.neutron [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating port 6584605e-8134-4b8a-823b-c7fa91e9edf2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquired lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG nova.compute.manager [req-5a6930a2-6b44-4209-9c50-e86533caf251 req-93ddad5e-2b88-446b-97bc-9749215b8d32 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-changed-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG nova.compute.manager [req-5a6930a2-6b44-4209-9c50-e86533caf251 req-93ddad5e-2b88-446b-97bc-9749215b8d32 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Refreshing instance network info cache due to event network-changed-6584605e-8134-4b8a-823b-c7fa91e9edf2. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5a6930a2-6b44-4209-9c50-e86533caf251 req-93ddad5e-2b88-446b-97bc-9749215b8d32 service nova] Acquiring lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating instance_info_cache with network_info: [{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Releasing lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:57:53 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Creating image(s)
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5a6930a2-6b44-4209-9c50-e86533caf251 req-93ddad5e-2b88-446b-97bc-9749215b8d32 service nova] Acquired lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG nova.network.neutron [req-5a6930a2-6b44-4209-9c50-e86533caf251 req-93ddad5e-2b88-446b-97bc-9749215b8d32 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Refreshing network info cache for port 6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG nova.objects.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<4fdf4aae-7ecd-448a-974d-56ff46abd39a> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "f90740eeba57167cd5a842ff28de3e470ec81008" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "f90740eeba57167cd5a842ff28de3e470ec81008" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008.part --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG nova.virt.images [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] 768847b8-6db1-4ec0-bc32-5787b1ab7b7a was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008.part /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG nova.network.neutron [req-5a6930a2-6b44-4209-9c50-e86533caf251 req-93ddad5e-2b88-446b-97bc-9749215b8d32 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updated VIF entry in instance network info cache for port 6584605e-8134-4b8a-823b-c7fa91e9edf2. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG nova.network.neutron [req-5a6930a2-6b44-4209-9c50-e86533caf251 req-93ddad5e-2b88-446b-97bc-9749215b8d32 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating instance_info_cache with network_info: [{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5a6930a2-6b44-4209-9c50-e86533caf251 req-93ddad5e-2b88-446b-97bc-9749215b8d32 service nova] Releasing lock "refresh_cache-4fdf4aae-7ecd-448a-974d-56ff46abd39a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008.part /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008.converted" returned: 0 in 0.388s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "f90740eeba57167cd5a842ff28de3e470ec81008" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.956s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008 --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "f90740eeba57167cd5a842ff28de3e470ec81008" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "f90740eeba57167cd5a842ff28de3e470ec81008" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008 --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008,backing_fmt=raw /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008,backing_fmt=raw /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk 1073741824" returned: 0 in 0.054s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "f90740eeba57167cd5a842ff28de3e470ec81008" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008 --force-share --output=json" returned: 0 in 0.188s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'migration_context' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG nova.objects.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<4fdf4aae-7ecd-448a-974d-56ff46abd39a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:57:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Rebasing disk image.
Aug 26 20:57:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b -F raw /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083463.5548093, d40cfba2-b7b6-4e80-947d-7d7dc031b2a5 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:57:58 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] VM Stopped (Lifecycle Event)
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-02185c1a-0d68-47fb-b3ac-d6188b215394 None None] [instance: d40cfba2-b7b6-4e80-947d-7d7dc031b2a5] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b -F raw /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk" returned: 0 in 2.176s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Ensure instance console log exists: /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Start _get_guest_xml network_info=[{"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6cbb89b667206d420865f5739762a3b1',container_format='bare',created_at=2023-08-26T20:55:47Z,direct_url=<?>,disk_format='qcow2',id=768847b8-6db1-4ec0-bc32-5787b1ab7b7a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1749490198-shelved',owner='69fdd3e8e61d47bd8a50affae1854448',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T20:55:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'attachment_id': '1534145a-011e-4472-bcd0-f7e67ef8e320', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbRoiLlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4fdf4aae-7ecd-448a-974d-56ff46abd39a', 'attached_at': '', 'detached_at': '', 'volume_id': '3f779043-76ba-4ff7-bc82-066e88836227', 'serial': '3f779043-76ba-4ff7-bc82-066e88836227'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:57:58 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:57:58 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6cbb89b667206d420865f5739762a3b1',container_format='bare',created_at=2023-08-26T20:55:47Z,direct_url=<?>,disk_format='qcow2',id=768847b8-6db1-4ec0-bc32-5787b1ab7b7a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1749490198-shelved',owner='69fdd3e8e61d47bd8a50affae1854448',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T20:55:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.objects.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<4fdf4aae-7ecd-448a-974d-56ff46abd39a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbRoiLlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:57:58 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:57:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:57:58 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:57:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:57:58 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddc422a-1385-42a8-a6c4-4aecf26f6709]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:57:58 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5393d5ad-2c39-49f4-b385-25cfdda18135]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227] added
Aug 26 20:57:58 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51cd945-2ab9-414e-9acf-994debd414e8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c63519-1a23-4721-a4b7-dc9aa2744255]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbRoiLlW {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbRoiLlW" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44bdb23-e401-493f-88be-a3710162434e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xbRoiLlW'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a0bf67-0a69-4e2b-947d-0acf1e0fbc42]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c785f82d-a08d-4fd6-9f60-916d287476f4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:59 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:59 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:57:59 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:57:59 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:57:59 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:57:59 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:57:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --login" returned: 0 in 1.066s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[10344732-23ec-4c4d-bfc2-aed85d573517]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227, portal: 172.16.0.220,3260]
Aug 26 20:58:00 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227, portal: 172.16.0.220,3260] successful.
Aug 26 20:58:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d307fbcf-981b-445e-8990-b12bd98ad5a4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74f77f3-546d-45b9-8e5d-3d63c5adaac1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:58:00 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:58:00 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:58:00 user nova-compute[73476]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)
Aug 26 20:58:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:58:00 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:58:00 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:58:00 user nova-compute[73476]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)
Aug 26 20:58:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.290s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff83da4b-1fa4-4b69-9255-bb63870f4f13]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbRoiLlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:58:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.327s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] <== connect_volume: return (2329ms) {'type': 'block', 'scsi_wwn': '26134356430643664', 'path': '/dev/sdd'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134356430643664', 'path': '/dev/sdd'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1749490198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1749490198',id=32,image_ref='768847b8-6db1-4ec0-bc32-5787b1ab7b7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2072190721',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-alt09urc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member',shelved_at='2023-08-26T20:55:52.258252',shelved_host='user',shelved_image_id='768847b8-6db1-4ec0-bc32-5787b1ab7b7a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=4fdf4aae-7ecd-448a-974d-56ff46abd39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.objects.base [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<4fdf4aae-7ecd-448a-974d-56ff46abd39a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:58:01 user nova-compute[73476]:   <uuid>4fdf4aae-7ecd-448a-974d-56ff46abd39a</uuid>
Aug 26 20:58:01 user nova-compute[73476]:   <name>instance-00000020</name>
Aug 26 20:58:01 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:58:01 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:58:01 user nova-compute[73476]:   <metadata>
Aug 26 20:58:01 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:58:01 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:58:01 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1749490198</nova:name>
Aug 26 20:58:01 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:57:58</nova:creationTime>
Aug 26 20:58:01 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:58:01 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:58:01 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:58:01 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:58:01 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:58:01 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:58:01 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:58:01 user nova-compute[73476]:       <nova:owner>
Aug 26 20:58:01 user nova-compute[73476]:         <nova:user uuid="23d582475c914098b5c6dce6268c2e2c">tempest-AttachVolumeShelveTestJSON-825342285-project-member</nova:user>
Aug 26 20:58:01 user nova-compute[73476]:         <nova:project uuid="69fdd3e8e61d47bd8a50affae1854448">tempest-AttachVolumeShelveTestJSON-825342285</nova:project>
Aug 26 20:58:01 user nova-compute[73476]:       </nova:owner>
Aug 26 20:58:01 user nova-compute[73476]:       <nova:root type="image" uuid="768847b8-6db1-4ec0-bc32-5787b1ab7b7a"/>
Aug 26 20:58:01 user nova-compute[73476]:       <nova:ports>
Aug 26 20:58:01 user nova-compute[73476]:         <nova:port uuid="6584605e-8134-4b8a-823b-c7fa91e9edf2">
Aug 26 20:58:01 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 20:58:01 user nova-compute[73476]:         </nova:port>
Aug 26 20:58:01 user nova-compute[73476]:       </nova:ports>
Aug 26 20:58:01 user nova-compute[73476]:     </nova:instance>
Aug 26 20:58:01 user nova-compute[73476]:   </metadata>
Aug 26 20:58:01 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:58:01 user nova-compute[73476]:     <system>
Aug 26 20:58:01 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:58:01 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:58:01 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:58:01 user nova-compute[73476]:       <entry name="serial">4fdf4aae-7ecd-448a-974d-56ff46abd39a</entry>
Aug 26 20:58:01 user nova-compute[73476]:       <entry name="uuid">4fdf4aae-7ecd-448a-974d-56ff46abd39a</entry>
Aug 26 20:58:01 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:58:01 user nova-compute[73476]:     </system>
Aug 26 20:58:01 user nova-compute[73476]:   </sysinfo>
Aug 26 20:58:01 user nova-compute[73476]:   <os>
Aug 26 20:58:01 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:58:01 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:58:01 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:58:01 user nova-compute[73476]:   </os>
Aug 26 20:58:01 user nova-compute[73476]:   <features>
Aug 26 20:58:01 user nova-compute[73476]:     <acpi/>
Aug 26 20:58:01 user nova-compute[73476]:     <apic/>
Aug 26 20:58:01 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:58:01 user nova-compute[73476]:   </features>
Aug 26 20:58:01 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:58:01 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:58:01 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:58:01 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:58:01 user nova-compute[73476]:   </clock>
Aug 26 20:58:01 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:58:01 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:58:01 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:58:01 user nova-compute[73476]:   </cpu>
Aug 26 20:58:01 user nova-compute[73476]:   <devices>
Aug 26 20:58:01 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:58:01 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:58:01 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk"/>
Aug 26 20:58:01 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:58:01 user nova-compute[73476]:     </disk>
Aug 26 20:58:01 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 20:58:01 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:58:01 user nova-compute[73476]:       <source dev="/dev/sdd"/>
Aug 26 20:58:01 user nova-compute[73476]:       <target dev="vdc" bus="virtio"/>
Aug 26 20:58:01 user nova-compute[73476]:       <serial>3f779043-76ba-4ff7-bc82-066e88836227</serial>
Aug 26 20:58:01 user nova-compute[73476]:     </disk>
Aug 26 20:58:01 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:58:01 user nova-compute[73476]:       <mac address="fa:16:3e:6d:f5:96"/>
Aug 26 20:58:01 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:58:01 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:58:01 user nova-compute[73476]:       <target dev="tap6584605e-81"/>
Aug 26 20:58:01 user nova-compute[73476]:     </interface>
Aug 26 20:58:01 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:58:01 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/console.log" append="off"/>
Aug 26 20:58:01 user nova-compute[73476]:     </serial>
Aug 26 20:58:01 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:58:01 user nova-compute[73476]:     <video>
Aug 26 20:58:01 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:58:01 user nova-compute[73476]:     </video>
Aug 26 20:58:01 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:58:01 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:58:01 user nova-compute[73476]:     </rng>
Aug 26 20:58:01 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:58:01 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:58:01 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:58:01 user nova-compute[73476]:     </memballoon>
Aug 26 20:58:01 user nova-compute[73476]:   </devices>
Aug 26 20:58:01 user nova-compute[73476]: </domain>
Aug 26 20:58:01 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1749490198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1749490198',id=32,image_ref='768847b8-6db1-4ec0-bc32-5787b1ab7b7a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2072190721',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-alt09urc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member',shelved_at='2023-08-26T20:55:52.258252',shelved_host='user',shelved_image_id='768847b8-6db1-4ec0-bc32-5787b1ab7b7a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=4fdf4aae-7ecd-448a-974d-56ff46abd39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG os_vif [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6584605e-81, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6584605e-81, col_values=(('external_ids', {'iface-id': '6584605e-8134-4b8a-823b-c7fa91e9edf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:f5:96', 'vm-uuid': '4fdf4aae-7ecd-448a-974d-56ff46abd39a'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:01 user nova-compute[73476]: INFO os_vif [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81')
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] No VIF found with MAC fa:16:3e:6d:f5:96, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:01 user nova-compute[73476]: INFO nova.compute.manager [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Terminating instance
Aug 26 20:58:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-ef356fb6-5572-474e-9416-6711851d0257 req-c5e8862f-be25-4ab0-9f99-f47b32c20be4 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-unplugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ef356fb6-5572-474e-9416-6711851d0257 req-c5e8862f-be25-4ab0-9f99-f47b32c20be4 service nova] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ef356fb6-5572-474e-9416-6711851d0257 req-c5e8862f-be25-4ab0-9f99-f47b32c20be4 service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ef356fb6-5572-474e-9416-6711851d0257 req-c5e8862f-be25-4ab0-9f99-f47b32c20be4 service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-ef356fb6-5572-474e-9416-6711851d0257 req-c5e8862f-be25-4ab0-9f99-f47b32c20be4 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] No waiting events found dispatching network-vif-unplugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-ef356fb6-5572-474e-9416-6711851d0257 req-c5e8862f-be25-4ab0-9f99-f47b32c20be4 service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-unplugged-15b711e1-203e-49ef-b25b-fac751706ef3 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Instance destroyed successfully.
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'resources' on Instance uuid 13e8971f-2d6c-4f8e-b895-411db3554e74 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1730290434',display_name='tempest-ServerRescueNegativeTestJSON-server-1730290434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1730290434',id=6,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:43:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-kr1306y7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:43:34Z,user_data=None,user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=13e8971f-2d6c-4f8e-b895-411db3554e74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "15b711e1-203e-49ef-b25b-fac751706ef3", "address": "fa:16:3e:a8:4f:0e", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b711e1-20", "ovs_interfaceid": "15b711e1-203e-49ef-b25b-fac751706ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4f:0e,bridge_name='br-int',has_traffic_filtering=True,id=15b711e1-203e-49ef-b25b-fac751706ef3,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b711e1-20') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG os_vif [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4f:0e,bridge_name='br-int',has_traffic_filtering=True,id=15b711e1-203e-49ef-b25b-fac751706ef3,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b711e1-20') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15b711e1-20, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: INFO os_vif [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4f:0e,bridge_name='br-int',has_traffic_filtering=True,id=15b711e1-203e-49ef-b25b-fac751706ef3,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b711e1-20')
Aug 26 20:58:03 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Deleting instance files /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74_del
Aug 26 20:58:03 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Deletion of /opt/stack/data/nova/instances/13e8971f-2d6c-4f8e-b895-411db3554e74_del complete
Aug 26 20:58:03 user nova-compute[73476]: INFO nova.compute.manager [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 26 20:58:03 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-dcdb26ca-3bd4-4652-b264-08325c70798e req-5bf768cd-4408-4df4-b3c4-5817c0d25653 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dcdb26ca-3bd4-4652-b264-08325c70798e req-5bf768cd-4408-4df4-b3c4-5817c0d25653 service nova] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dcdb26ca-3bd4-4652-b264-08325c70798e req-5bf768cd-4408-4df4-b3c4-5817c0d25653 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dcdb26ca-3bd4-4652-b264-08325c70798e req-5bf768cd-4408-4df4-b3c4-5817c0d25653 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-dcdb26ca-3bd4-4652-b264-08325c70798e req-5bf768cd-4408-4df4-b3c4-5817c0d25653 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] No waiting events found dispatching network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:03 user nova-compute[73476]: WARNING nova.compute.manager [req-dcdb26ca-3bd4-4652-b264-08325c70798e req-5bf768cd-4408-4df4-b3c4-5817c0d25653 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received unexpected event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 20:58:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "215be88c-8470-453f-b293-ce98148be308" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "215be88c-8470-453f-b293-ce98148be308" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "215be88c-8470-453f-b293-ce98148be308-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "215be88c-8470-453f-b293-ce98148be308-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "215be88c-8470-453f-b293-ce98148be308-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:03 user nova-compute[73476]: INFO nova.compute.manager [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Terminating instance
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:58:03 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Took 0.76 seconds to deallocate network for instance.
Aug 26 20:58:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-58fcb43f-2beb-4b4d-b917-74789ca52089 req-57cbd870-6545-4dd5-8cd8-5310a4b1938b service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-deleted-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:04 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 215be88c-8470-453f-b293-ce98148be308] Instance destroyed successfully.
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.objects.instance [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lazy-loading 'resources' on Instance uuid 215be88c-8470-453f-b293-ce98148be308 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1359566345',display_name='tempest-ServerActionsTestOtherA-server-1359566345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1359566345',id=4,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrUMTyGNKdGpzDsrysQPohyAkRqtJhi3sdBZorTU8L/A2dHf0ht3Zah6gdCoAeVQTlLTdvxBfzTJPbHDiEF3xFnMtXTZ/YbW5aEqOqGzGXK2CkdK6c5/YxdHT2BmY6wkQ==',key_name='tempest-keypair-2137585327',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:41:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b16d8f644f0442fea1f8a57961111a30',ramdisk_id='',reservation_id='r-9wz6crun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1600580756',owner_user_name='tempest-ServerActionsTestOtherA-1600580756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:41:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf18fb0dcd64e11a7e42cc5184a219e',uuid=215be88c-8470-453f-b293-ce98148be308,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converting VIF {"id": "b6751288-099f-4014-9eaa-40b28f0baec4", "address": "fa:16:3e:c4:78:7d", "network": {"id": "6b9ea49c-f02b-4c6f-96f5-abbae3416597", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-481728464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b16d8f644f0442fea1f8a57961111a30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6751288-09", "ovs_interfaceid": "b6751288-099f-4014-9eaa-40b28f0baec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=b6751288-099f-4014-9eaa-40b28f0baec4,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6751288-09') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG os_vif [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=b6751288-099f-4014-9eaa-40b28f0baec4,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6751288-09') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6751288-09, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:04 user nova-compute[73476]: INFO os_vif [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:78:7d,bridge_name='br-int',has_traffic_filtering=True,id=b6751288-099f-4014-9eaa-40b28f0baec4,network=Network(6b9ea49c-f02b-4c6f-96f5-abbae3416597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6751288-09')
Aug 26 20:58:04 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Deleting instance files /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308_del
Aug 26 20:58:04 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Deletion of /opt/stack/data/nova/instances/215be88c-8470-453f-b293-ce98148be308_del complete
Aug 26 20:58:04 user nova-compute[73476]: INFO nova.compute.manager [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] [instance: 215be88c-8470-453f-b293-ce98148be308] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 215be88c-8470-453f-b293-ce98148be308] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 215be88c-8470-453f-b293-ce98148be308] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] Acquiring lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] No waiting events found dispatching network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:04 user nova-compute[73476]: WARNING nova.compute.manager [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Received unexpected event network-vif-plugged-15b711e1-203e-49ef-b25b-fac751706ef3 for instance with vm_state deleted and task_state None.
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received event network-vif-unplugged-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] Acquiring lock "215be88c-8470-453f-b293-ce98148be308-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] Lock "215be88c-8470-453f-b293-ce98148be308-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] Lock "215be88c-8470-453f-b293-ce98148be308-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] No waiting events found dispatching network-vif-unplugged-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-49a13cba-6ff9-4b47-ae8c-3ff133b6618f req-875186ae-7713-4f86-93a5-0183dbedf07f service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received event network-vif-unplugged-b6751288-099f-4014-9eaa-40b28f0baec4 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:04 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Deleted allocations for instance 13e8971f-2d6c-4f8e-b895-411db3554e74
Aug 26 20:58:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4fe99a78-6781-4451-b2fe-1567e06ac098 tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "13e8971f-2d6c-4f8e-b895-411db3554e74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.045s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 215be88c-8470-453f-b293-ce98148be308] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:58:05 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 215be88c-8470-453f-b293-ce98148be308] Took 0.66 seconds to deallocate network for instance.
Aug 26 20:58:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-ee98e602-f820-460c-bd03-d2b44ced90be req-d27d6bfa-13fe-4155-bc64-111c67a19b19 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ee98e602-f820-460c-bd03-d2b44ced90be req-d27d6bfa-13fe-4155-bc64-111c67a19b19 service nova] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ee98e602-f820-460c-bd03-d2b44ced90be req-d27d6bfa-13fe-4155-bc64-111c67a19b19 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ee98e602-f820-460c-bd03-d2b44ced90be req-d27d6bfa-13fe-4155-bc64-111c67a19b19 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-ee98e602-f820-460c-bd03-d2b44ced90be req-d27d6bfa-13fe-4155-bc64-111c67a19b19 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] No waiting events found dispatching network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:05 user nova-compute[73476]: WARNING nova.compute.manager [req-ee98e602-f820-460c-bd03-d2b44ced90be req-d27d6bfa-13fe-4155-bc64-111c67a19b19 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received unexpected event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:05 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Deleted allocations for instance 215be88c-8470-453f-b293-ce98148be308
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083485.5726244, 4fdf4aae-7ecd-448a-974d-56ff46abd39a => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:58:05 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] VM Resumed (Lifecycle Event)
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 20:58:05 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance spawned successfully.
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-96cfc6e6-8939-476a-979d-711878a9bada tempest-ServerActionsTestOtherA-1600580756 tempest-ServerActionsTestOtherA-1600580756-project-member] Lock "215be88c-8470-453f-b293-ce98148be308" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:05 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083485.5739145, 4fdf4aae-7ecd-448a-974d-56ff46abd39a => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:58:05 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] VM Started (Lifecycle Event)
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:58:05 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 20:58:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:58:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-7dc4098d-6448-49fc-92c4-738ff9556d97 req-b54c6520-83ca-4a68-9568-0ff3a2c8ff95 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received event network-vif-deleted-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2ea6c991-f889-48f8-a39c-ba01a8cc75dc tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.529s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-0c3bd479-94ca-4b15-9cd8-d558d8257a0c req-b890a048-e951-4d30-85f3-6f5bd5a18629 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received event network-vif-plugged-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0c3bd479-94ca-4b15-9cd8-d558d8257a0c req-b890a048-e951-4d30-85f3-6f5bd5a18629 service nova] Acquiring lock "215be88c-8470-453f-b293-ce98148be308-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0c3bd479-94ca-4b15-9cd8-d558d8257a0c req-b890a048-e951-4d30-85f3-6f5bd5a18629 service nova] Lock "215be88c-8470-453f-b293-ce98148be308-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0c3bd479-94ca-4b15-9cd8-d558d8257a0c req-b890a048-e951-4d30-85f3-6f5bd5a18629 service nova] Lock "215be88c-8470-453f-b293-ce98148be308-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-0c3bd479-94ca-4b15-9cd8-d558d8257a0c req-b890a048-e951-4d30-85f3-6f5bd5a18629 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] No waiting events found dispatching network-vif-plugged-b6751288-099f-4014-9eaa-40b28f0baec4 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:06 user nova-compute[73476]: WARNING nova.compute.manager [req-0c3bd479-94ca-4b15-9cd8-d558d8257a0c req-b890a048-e951-4d30-85f3-6f5bd5a18629 service nova] [instance: 215be88c-8470-453f-b293-ce98148be308] Received unexpected event network-vif-plugged-b6751288-099f-4014-9eaa-40b28f0baec4 for instance with vm_state deleted and task_state None.
Aug 26 20:58:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:18 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083483.0458078, 13e8971f-2d6c-4f8e-b895-411db3554e74 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:58:18 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] VM Stopped (Lifecycle Event)
Aug 26 20:58:18 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7a00b3dd-9931-4bf8-b317-9c8f89df628b None None] [instance: 13e8971f-2d6c-4f8e-b895-411db3554e74] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:58:19 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083484.2279873, 215be88c-8470-453f-b293-ce98148be308 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:58:19 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 215be88c-8470-453f-b293-ce98148be308] VM Stopped (Lifecycle Event)
Aug 26 20:58:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-95f5b59e-c162-401a-8d08-15e6f58d6043 None None] [instance: 215be88c-8470-453f-b293-ce98148be308] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:58:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 22b50300-8865-4854-b0c7-ed63ca60c85b {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 1dddc689-a053-46d4-a29e-52c8fe78c76d {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 267a25c3-a5ab-4772-add0-33b854a44c23 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "22b50300-8865-4854-b0c7-ed63ca60c85b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "1dddc689-a053-46d4-a29e-52c8fe78c76d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:33 user nova-compute[73476]: INFO nova.compute.manager [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Terminating instance
Aug 26 20:58:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-43443378-0022-4eb0-a604-1376a5ff8b24 req-46197259-17ec-4542-b1b0-51e4885bd0a3 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-unplugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-43443378-0022-4eb0-a604-1376a5ff8b24 req-46197259-17ec-4542-b1b0-51e4885bd0a3 service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-43443378-0022-4eb0-a604-1376a5ff8b24 req-46197259-17ec-4542-b1b0-51e4885bd0a3 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-43443378-0022-4eb0-a604-1376a5ff8b24 req-46197259-17ec-4542-b1b0-51e4885bd0a3 service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-43443378-0022-4eb0-a604-1376a5ff8b24 req-46197259-17ec-4542-b1b0-51e4885bd0a3 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-unplugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-43443378-0022-4eb0-a604-1376a5ff8b24 req-46197259-17ec-4542-b1b0-51e4885bd0a3 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-unplugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:33 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Instance destroyed successfully.
Aug 26 20:58:33 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'resources' on Instance uuid 8644e702-6fc8-4c84-a208-ef9a78cda0ee {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-329720098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-329720098',id=29,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:55:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-bjxqghlw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:56:49Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=8644e702-6fc8-4c84-a208-ef9a78cda0ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "address": "fa:16:3e:43:d5:a5", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b7fc934-fd", "ovs_interfaceid": "9b7fc934-fd11-4397-92d8-3aa023d9e63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=9b7fc934-fd11-4397-92d8-3aa023d9e63b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7fc934-fd') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_vif [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=9b7fc934-fd11-4397-92d8-3aa023d9e63b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7fc934-fd') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b7fc934-fd, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:58:33 user nova-compute[73476]: INFO os_vif [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:d5:a5,bridge_name='br-int',has_traffic_filtering=True,id=9b7fc934-fd11-4397-92d8-3aa023d9e63b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b7fc934-fd')
Aug 26 20:58:33 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFrSDmag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:58:33 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee901bc8-ee74-4027-be06-4488e0a834d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20ecb66-88b3-41f3-89de-5ff985cd0a64\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[484603b8-3567-496b-b84f-f3f962a7e950]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20ecb66-88b3-41f3-89de-5ff985cd0a64 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:58:33 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:58:33 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:58:33 user nova-compute[73476]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)
Aug 26 20:58:33 user nova-compute[73476]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20ecb66-88b3-41f3-89de-5ff985cd0a64 (non-flash)
Aug 26 20:58:33 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:58:33 user nova-compute[73476]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb (non-flash)
Aug 26 20:58:33 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:58:33 user nova-compute[73476]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)
Aug 26 20:58:33 user nova-compute[73476]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20ecb66-88b3-41f3-89de-5ff985cd0a64 (non-flash)
Aug 26 20:58:33 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b056caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e69b962-c8d4-4729-b6d7-6cfa1ec38823]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[933ea4dd-9330-4500-9cec-7a870b96bcdc]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[826f8a9f-4c5a-4a42-97be-a47d261b818c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:58:33 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7741197e-c581-47c2-900a-507ed9828ead]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8876abfd-0da3-4fff-8b4c-07c6b273e9f2]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c6cb0-7faf-4ffc-a2a9-f0cc77834d02]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb, portal: 172.16.0.220,3260]
Aug 26 20:58:34 user nova-compute[73476]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb, portal: 172.16.0.220,3260] successful.
Aug 26 20:58:34 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:769f3a13-ce9a-4343-aa19-4fd3d34a90fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc263333-9c7f-4aa1-8109-b3127c8d8585]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] <== disconnect_volume: return (381ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:58:34 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Deleting instance files /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee_del
Aug 26 20:58:34 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Deletion of /opt/stack/data/nova/instances/8644e702-6fc8-4c84-a208-ef9a78cda0ee_del complete
Aug 26 20:58:34 user nova-compute[73476]: INFO nova.compute.manager [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 26 20:58:34 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:58:34 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:58:35 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:58:35 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Took 1.02 seconds to deallocate network for instance.
Aug 26 20:58:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-f706d016-66b3-438f-a840-352ff41e8726 req-b5c502b8-f398-45aa-b607-7cdaa7fe2e64 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-deleted-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:35 user nova-compute[73476]: INFO nova.compute.manager [req-f706d016-66b3-438f-a840-352ff41e8726 req-b5c502b8-f398-45aa-b607-7cdaa7fe2e64 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Neutron deleted interface 9b7fc934-fd11-4397-92d8-3aa023d9e63b; detaching it from the instance and deleting it from the info cache
Aug 26 20:58:35 user nova-compute[73476]: DEBUG nova.network.neutron [req-f706d016-66b3-438f-a840-352ff41e8726 req-b5c502b8-f398-45aa-b607-7cdaa7fe2e64 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:58:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-f706d016-66b3-438f-a840-352ff41e8726 req-b5c502b8-f398-45aa-b607-7cdaa7fe2e64 service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Detach interface failed, port_id=9b7fc934-fd11-4397-92d8-3aa023d9e63b, reason: Instance 8644e702-6fc8-4c84-a208-ef9a78cda0ee could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 20:58:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-edfc552f-ff33-4d30-8512-c630e4b5f911 req-e417030d-3204-4a10-b00b-26a6f379d6ea service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-edfc552f-ff33-4d30-8512-c630e4b5f911 req-e417030d-3204-4a10-b00b-26a6f379d6ea service nova] Acquiring lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-edfc552f-ff33-4d30-8512-c630e4b5f911 req-e417030d-3204-4a10-b00b-26a6f379d6ea service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-edfc552f-ff33-4d30-8512-c630e4b5f911 req-e417030d-3204-4a10-b00b-26a6f379d6ea service nova] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-edfc552f-ff33-4d30-8512-c630e4b5f911 req-e417030d-3204-4a10-b00b-26a6f379d6ea service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] No waiting events found dispatching network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:35 user nova-compute[73476]: WARNING nova.compute.manager [req-edfc552f-ff33-4d30-8512-c630e4b5f911 req-e417030d-3204-4a10-b00b-26a6f379d6ea service nova] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Received unexpected event network-vif-plugged-9b7fc934-fd11-4397-92d8-3aa023d9e63b for instance with vm_state active and task_state deleting.
Aug 26 20:58:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:58:36 user nova-compute[73476]: INFO nova.compute.manager [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Took 0.98 seconds to detach 1 volumes for instance.
Aug 26 20:58:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:36 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:58:36 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:58:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:36 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Deleted allocations for instance 8644e702-6fc8-4c84-a208-ef9a78cda0ee
Aug 26 20:58:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cc03a34-5c0d-4e54-8e6b-b9735f81103d tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "8644e702-6fc8-4c84-a208-ef9a78cda0ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.853s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:43 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:43 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:58:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:58:44 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:58:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:58:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.372s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:58:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:58:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:58:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=24.13970947265625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 531953d6-502b-4f11-8a53-0bf267bec1f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1dddc689-a053-46d4-a29e-52c8fe78c76d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 267a25c3-a5ab-4772-add0-33b854a44c23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083513.7693837, 8644e702-6fc8-4c84-a208-ef9a78cda0ee => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:58:48 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] VM Stopped (Lifecycle Event)
Aug 26 20:58:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-dbc2bfda-e6ff-4b70-9185-75df331bf8fb None None] [instance: 8644e702-6fc8-4c84-a208-ef9a78cda0ee] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:58:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:58:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:58:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:58:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:58:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:58:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:58:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updating instance_info_cache with network_info: [{"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:58:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-c2b05cbc-2666-4c5c-9a5b-be01236a1229" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:58:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:52 user nova-compute[73476]: INFO nova.compute.manager [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Terminating instance
Aug 26 20:58:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-e5a3aaeb-e550-45ec-9f97-efb8d72e8fa2 req-42d46961-e7c6-4eb7-b33b-33b7525904dc service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e5a3aaeb-e550-45ec-9f97-efb8d72e8fa2 req-42d46961-e7c6-4eb7-b33b-33b7525904dc service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e5a3aaeb-e550-45ec-9f97-efb8d72e8fa2 req-42d46961-e7c6-4eb7-b33b-33b7525904dc service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e5a3aaeb-e550-45ec-9f97-efb8d72e8fa2 req-42d46961-e7c6-4eb7-b33b-33b7525904dc service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-e5a3aaeb-e550-45ec-9f97-efb8d72e8fa2 req-42d46961-e7c6-4eb7-b33b-33b7525904dc service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-e5a3aaeb-e550-45ec-9f97-efb8d72e8fa2 req-42d46961-e7c6-4eb7-b33b-33b7525904dc service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-unplugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:58:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Instance destroyed successfully.
Aug 26 20:58:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lazy-loading 'resources' on Instance uuid 531953d6-502b-4f11-8a53-0bf267bec1f0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1167118621',display_name='tempest-ServerRescueNegativeTestJSON-server-1167118621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1167118621',id=3,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c713d9f0cc5f4dd7a8629ba1b27e72f0',ramdisk_id='',reservation_id='r-j4eiyvfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-552908196',owner_user_name='tempest-ServerRescueNegativeTestJSON-552908196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:48:21Z,user_data=None,user_id='eb63707c9d734bf5b1d1bb20162e3204',uuid=531953d6-502b-4f11-8a53-0bf267bec1f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converting VIF {"id": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "address": "fa:16:3e:00:c3:ed", "network": {"id": "ae26fd18-6620-459b-b0f5-aa75526d18f4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2065971302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c713d9f0cc5f4dd7a8629ba1b27e72f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21f3f69-c4", "ovs_interfaceid": "f21f3f69-c470-4a8e-9166-7b8a4dee07fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:c3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f21f3f69-c470-4a8e-9166-7b8a4dee07fb,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21f3f69-c4') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG os_vif [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:c3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f21f3f69-c470-4a8e-9166-7b8a4dee07fb,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21f3f69-c4') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf21f3f69-c4, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:58:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:58:52 user nova-compute[73476]: INFO os_vif [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:c3:ed,bridge_name='br-int',has_traffic_filtering=True,id=f21f3f69-c470-4a8e-9166-7b8a4dee07fb,network=Network(ae26fd18-6620-459b-b0f5-aa75526d18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21f3f69-c4')
Aug 26 20:58:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Deleting instance files /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0_del
Aug 26 20:58:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Deletion of /opt/stack/data/nova/instances/531953d6-502b-4f11-8a53-0bf267bec1f0_del complete
Aug 26 20:58:53 user nova-compute[73476]: INFO nova.compute.manager [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 26 20:58:53 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:58:53 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:58:53 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:58:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:53 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:58:53 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Took 0.52 seconds to deallocate network for instance.
Aug 26 20:58:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:53 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:58:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:58:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:53 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Deleted allocations for instance 531953d6-502b-4f11-8a53-0bf267bec1f0
Aug 26 20:58:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7f8a4e85-a9bb-4e87-b62d-a38afde30a5c tempest-ServerRescueNegativeTestJSON-552908196 tempest-ServerRescueNegativeTestJSON-552908196-project-member] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.675s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-bd87f144-868d-483e-b1ae-ff7d1359cc15 req-8d8a8acd-9bda-4d0a-9724-34ad0a776493 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bd87f144-868d-483e-b1ae-ff7d1359cc15 req-8d8a8acd-9bda-4d0a-9724-34ad0a776493 service nova] Acquiring lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bd87f144-868d-483e-b1ae-ff7d1359cc15 req-8d8a8acd-9bda-4d0a-9724-34ad0a776493 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bd87f144-868d-483e-b1ae-ff7d1359cc15 req-8d8a8acd-9bda-4d0a-9724-34ad0a776493 service nova] Lock "531953d6-502b-4f11-8a53-0bf267bec1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-bd87f144-868d-483e-b1ae-ff7d1359cc15 req-8d8a8acd-9bda-4d0a-9724-34ad0a776493 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] No waiting events found dispatching network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:54 user nova-compute[73476]: WARNING nova.compute.manager [req-bd87f144-868d-483e-b1ae-ff7d1359cc15 req-8d8a8acd-9bda-4d0a-9724-34ad0a776493 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received unexpected event network-vif-plugged-f21f3f69-c470-4a8e-9166-7b8a4dee07fb for instance with vm_state deleted and task_state None.
Aug 26 20:58:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-bd87f144-868d-483e-b1ae-ff7d1359cc15 req-8d8a8acd-9bda-4d0a-9724-34ad0a776493 service nova] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Received event network-vif-deleted-f21f3f69-c470-4a8e-9166-7b8a4dee07fb {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:55 user nova-compute[73476]: INFO nova.compute.manager [None req-9f65481f-4f23-4b4c-8f74-75fa386fd43e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Unrescuing
Aug 26 20:58:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9f65481f-4f23-4b4c-8f74-75fa386fd43e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:58:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9f65481f-4f23-4b4c-8f74-75fa386fd43e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquired lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:58:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9f65481f-4f23-4b4c-8f74-75fa386fd43e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:58:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-9f65481f-4f23-4b4c-8f74-75fa386fd43e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:58:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9f65481f-4f23-4b4c-8f74-75fa386fd43e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Releasing lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:58:56 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9f65481f-4f23-4b4c-8f74-75fa386fd43e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'flavor' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:58:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-dbedfda6-b306-4ca2-a6ae-c74b685fd838 req-c9fc0f3b-7466-4d31-9a5b-8ff011e18318 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dbedfda6-b306-4ca2-a6ae-c74b685fd838 req-c9fc0f3b-7466-4d31-9a5b-8ff011e18318 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dbedfda6-b306-4ca2-a6ae-c74b685fd838 req-c9fc0f3b-7466-4d31-9a5b-8ff011e18318 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dbedfda6-b306-4ca2-a6ae-c74b685fd838 req-c9fc0f3b-7466-4d31-9a5b-8ff011e18318 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-dbedfda6-b306-4ca2-a6ae-c74b685fd838 req-c9fc0f3b-7466-4d31-9a5b-8ff011e18318 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:57 user nova-compute[73476]: WARNING nova.compute.manager [req-dbedfda6-b306-4ca2-a6ae-c74b685fd838 req-c9fc0f3b-7466-4d31-9a5b-8ff011e18318 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Instance destroyed successfully.
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:58:59 user nova-compute[73476]: WARNING nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:58:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-changed-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Refreshing instance network info cache due to event network-changed-4fbe332d-e987-48c7-9ddf-94e0e0427864. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Acquiring lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Acquired lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG nova.network.neutron [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Refreshing network info cache for port 4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:58:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:00 user nova-compute[73476]: DEBUG nova.network.neutron [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updated VIF entry in instance network info cache for port 4fbe332d-e987-48c7-9ddf-94e0e0427864. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:59:00 user nova-compute[73476]: DEBUG nova.network.neutron [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:59:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Releasing lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:59:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-changed-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Refreshing instance network info cache due to event network-changed-4fbe332d-e987-48c7-9ddf-94e0e0427864. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:59:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Acquiring lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:59:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Acquired lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:59:00 user nova-compute[73476]: DEBUG nova.network.neutron [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Refreshing network info cache for port 4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:59:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:59:01 user nova-compute[73476]: WARNING nova.compute.manager [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:59:01 user nova-compute[73476]: WARNING nova.compute.manager [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:59:01 user nova-compute[73476]: WARNING nova.compute.manager [req-e96d0344-5d52-41b1-990b-d5c3e51ae56f req-999abed9-73cf-4910-8e42-d61b3cc9b205 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Removed pending event for 8e964b8e-c28a-4f58-ad0e-d34212a36e42 due to event {{(pid=73476) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083541.1781943, 8e964b8e-c28a-4f58-ad0e-d34212a36e42 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:59:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] VM Resumed (Lifecycle Event)
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9f65481f-4f23-4b4c-8f74-75fa386fd43e tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:59:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083541.1816943, 8e964b8e-c28a-4f58-ad0e-d34212a36e42 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:59:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] VM Started (Lifecycle Event)
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.network.neutron [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updated VIF entry in instance network info cache for port 4fbe332d-e987-48c7-9ddf-94e0e0427864. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.network.neutron [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Releasing lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:59:01 user nova-compute[73476]: WARNING nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:59:01 user nova-compute[73476]: WARNING nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:59:01 user nova-compute[73476]: WARNING nova.compute.manager [req-7194276f-779f-419a-81b9-03b8677a7801 req-2513dae2-9177-4a90-9ca0-991eb06e6b6c service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state rescued and task_state unrescuing.
Aug 26 20:59:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:07 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083532.8823917, 531953d6-502b-4f11-8a53-0bf267bec1f0 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:59:07 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] VM Stopped (Lifecycle Event)
Aug 26 20:59:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-a7b40e69-82ad-43f8-ae62-47488f690eed None None] [instance: 531953d6-502b-4f11-8a53-0bf267bec1f0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:59:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:59:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "1dddc689-a053-46d4-a29e-52c8fe78c76d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:23 user nova-compute[73476]: INFO nova.compute.manager [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Terminating instance
Aug 26 20:59:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 20:59:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-8d688d99-1d72-4c27-9b02-2b5069b11ecc req-f247ee26-c493-47c8-aa4e-46218f21bb79 service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received event network-vif-unplugged-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8d688d99-1d72-4c27-9b02-2b5069b11ecc req-f247ee26-c493-47c8-aa4e-46218f21bb79 service nova] Acquiring lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8d688d99-1d72-4c27-9b02-2b5069b11ecc req-f247ee26-c493-47c8-aa4e-46218f21bb79 service nova] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8d688d99-1d72-4c27-9b02-2b5069b11ecc req-f247ee26-c493-47c8-aa4e-46218f21bb79 service nova] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-8d688d99-1d72-4c27-9b02-2b5069b11ecc req-f247ee26-c493-47c8-aa4e-46218f21bb79 service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] No waiting events found dispatching network-vif-unplugged-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-8d688d99-1d72-4c27-9b02-2b5069b11ecc req-f247ee26-c493-47c8-aa4e-46218f21bb79 service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received event network-vif-unplugged-bcb0b945-ae35-4b28-8629-d940710dd62b for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:24 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Instance destroyed successfully.
Aug 26 20:59:24 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'resources' on Instance uuid 1dddc689-a053-46d4-a29e-52c8fe78c76d {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-524100273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-524100273',id=23,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-5aa3cnzp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:51:57Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=1dddc689-a053-46d4-a29e-52c8fe78c76d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "bcb0b945-ae35-4b28-8629-d940710dd62b", "address": "fa:16:3e:65:19:5d", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb0b945-ae", "ovs_interfaceid": "bcb0b945-ae35-4b28-8629-d940710dd62b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcb0b945-ae35-4b28-8629-d940710dd62b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb0b945-ae') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG os_vif [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcb0b945-ae35-4b28-8629-d940710dd62b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb0b945-ae') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcb0b945-ae, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:59:24 user nova-compute[73476]: INFO os_vif [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:5d,bridge_name='br-int',has_traffic_filtering=True,id=bcb0b945-ae35-4b28-8629-d940710dd62b,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb0b945-ae')
Aug 26 20:59:24 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Deleting instance files /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d_del
Aug 26 20:59:24 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Deletion of /opt/stack/data/nova/instances/1dddc689-a053-46d4-a29e-52c8fe78c76d_del complete
Aug 26 20:59:24 user nova-compute[73476]: INFO nova.compute.manager [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 20:59:24 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 20:59:24 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 20:59:25 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:59:25 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Took 0.62 seconds to deallocate network for instance.
Aug 26 20:59:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-d1ff55e3-793d-4436-9ee2-6aec6b90fbbe req-7edaae03-2c97-413c-a164-59f43a6c0c83 service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received event network-vif-deleted-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:25 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:59:25 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:59:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:25 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Deleted allocations for instance 1dddc689-a053-46d4-a29e-52c8fe78c76d
Aug 26 20:59:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d33dd620-25ab-4e7d-b976-224b11eeda6b tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.905s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-5d73603b-fbf7-47c6-8d2a-fa0fe88468e9 req-c4b7394e-0495-4444-a63d-294f2550514a service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received event network-vif-plugged-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5d73603b-fbf7-47c6-8d2a-fa0fe88468e9 req-c4b7394e-0495-4444-a63d-294f2550514a service nova] Acquiring lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5d73603b-fbf7-47c6-8d2a-fa0fe88468e9 req-c4b7394e-0495-4444-a63d-294f2550514a service nova] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:26 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5d73603b-fbf7-47c6-8d2a-fa0fe88468e9 req-c4b7394e-0495-4444-a63d-294f2550514a service nova] Lock "1dddc689-a053-46d4-a29e-52c8fe78c76d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:26 user nova-compute[73476]: DEBUG nova.compute.manager [req-5d73603b-fbf7-47c6-8d2a-fa0fe88468e9 req-c4b7394e-0495-4444-a63d-294f2550514a service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] No waiting events found dispatching network-vif-plugged-bcb0b945-ae35-4b28-8629-d940710dd62b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:59:26 user nova-compute[73476]: WARNING nova.compute.manager [req-5d73603b-fbf7-47c6-8d2a-fa0fe88468e9 req-c4b7394e-0495-4444-a63d-294f2550514a service nova] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Received unexpected event network-vif-plugged-bcb0b945-ae35-4b28-8629-d940710dd62b for instance with vm_state deleted and task_state None.
Aug 26 20:59:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:29 user nova-compute[73476]: INFO nova.compute.manager [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Detaching volume 6d25776e-2b92-4555-84ca-998d013c2032
Aug 26 20:59:29 user nova-compute[73476]: INFO nova.virt.block_device [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Attempting to driver detach volume 6d25776e-2b92-4555-84ca-998d013c2032 from mountpoint /dev/vdb
Aug 26 20:59:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Attempting to detach device vdb from instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:59:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:59:29 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:59:29 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 20:59:29 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:59:29 user nova-compute[73476]:   <serial>6d25776e-2b92-4555-84ca-998d013c2032</serial>
Aug 26 20:59:29 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:59:29 user nova-compute[73476]: </disk>
Aug 26 20:59:29 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:59:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Successfully detached device vdb from instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 from the persistent domain config.
Aug 26 20:59:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:59:29 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:59:29 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:59:29 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 20:59:29 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:59:29 user nova-compute[73476]:   <serial>6d25776e-2b92-4555-84ca-998d013c2032</serial>
Aug 26 20:59:29 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:59:29 user nova-compute[73476]: </disk>
Aug 26 20:59:29 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-a0fba982-5f0b-488d-9127-1c64915ab1f4 req-dad56075-2343-413a-b9e1-1c30903ee7ec service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received event network-changed-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.compute.manager [req-a0fba982-5f0b-488d-9127-1c64915ab1f4 req-dad56075-2343-413a-b9e1-1c30903ee7ec service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Refreshing instance network info cache due to event network-changed-391ff021-f70e-4a2d-99dc-554838d9a3c1. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a0fba982-5f0b-488d-9127-1c64915ab1f4 req-dad56075-2343-413a-b9e1-1c30903ee7ec service nova] Acquiring lock "refresh_cache-267a25c3-a5ab-4772-add0-33b854a44c23" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a0fba982-5f0b-488d-9127-1c64915ab1f4 req-dad56075-2343-413a-b9e1-1c30903ee7ec service nova] Acquired lock "refresh_cache-267a25c3-a5ab-4772-add0-33b854a44c23" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.network.neutron [req-a0fba982-5f0b-488d-9127-1c64915ab1f4 req-dad56075-2343-413a-b9e1-1c30903ee7ec service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Refreshing network info cache for port 391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083570.3506124, 8e964b8e-c28a-4f58-ad0e-d34212a36e42 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:59:30 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Successfully detached device vdb from instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 from the live domain config.
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGTYAWzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:59:30 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:30 user nova-compute[73476]: INFO nova.compute.manager [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Detaching volume 3f779043-76ba-4ff7-bc82-066e88836227
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea9f59e-9a0e-4104-953c-c88e3b3d35a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8193cda5-2bee-4534-a889-b17323e4562d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:30 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:59:30 user nova-compute[73476]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)
Aug 26 20:59:30 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:30 user nova-compute[73476]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 (non-flash)
Aug 26 20:59:30 user nova-compute[73476]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)
Aug 26 20:59:30 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b01260e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcf461d-7ea1-45ae-bf40-0b0dd548c676]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: INFO nova.virt.block_device [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Attempting to driver detach volume 3f779043-76ba-4ff7-bc82-066e88836227 from mountpoint /dev/vdc
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Attempting to detach device vdc from instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:59:30 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:59:30 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 20:59:30 user nova-compute[73476]:   <target dev="vdc" bus="virtio"/>
Aug 26 20:59:30 user nova-compute[73476]:   <serial>3f779043-76ba-4ff7-bc82-066e88836227</serial>
Aug 26 20:59:30 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 20:59:30 user nova-compute[73476]: </disk>
Aug 26 20:59:30 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[82042ce9-35e5-4b7a-8eac-aa03cec15073]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully detached device vdc from instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a from the persistent domain config.
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:59:30 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:59:30 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 20:59:30 user nova-compute[73476]:   <target dev="vdc" bus="virtio"/>
Aug 26 20:59:30 user nova-compute[73476]:   <serial>3f779043-76ba-4ff7-bc82-066e88836227</serial>
Aug 26 20:59:30 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 20:59:30 user nova-compute[73476]: </disk>
Aug 26 20:59:30 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[532b73b3-195f-4262-aa41-8f6b8657cf3c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[185eec69-beff-4873-90c6-88516a6d2665]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afa4e25-64b8-48a0-815b-5c0f4eb12969]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[041c8882-8639-472f-ac33-7a50f311112c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032, portal: 172.16.0.220,3260]
Aug 26 20:59:30 user nova-compute[73476]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032, portal: 172.16.0.220,3260] successful.
Aug 26 20:59:30 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d25776e-2b92-4555-84ca-998d013c2032 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e539745-fa5b-4cf3-8c3b-06250e33660d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] <== disconnect_volume: return (323ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.network.neutron [req-a0fba982-5f0b-488d-9127-1c64915ab1f4 req-dad56075-2343-413a-b9e1-1c30903ee7ec service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Updated VIF entry in instance network info cache for port 391ff021-f70e-4a2d-99dc-554838d9a3c1. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.network.neutron [req-a0fba982-5f0b-488d-9127-1c64915ab1f4 req-dad56075-2343-413a-b9e1-1c30903ee7ec service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Updating instance_info_cache with network_info: [{"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a0fba982-5f0b-488d-9127-1c64915ab1f4 req-dad56075-2343-413a-b9e1-1c30903ee7ec service nova] Releasing lock "refresh_cache-267a25c3-a5ab-4772-add0-33b854a44c23" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083570.949631, 4fdf4aae-7ecd-448a-974d-56ff46abd39a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:59:30 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully detached device vdc from instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a from the live domain config.
Aug 26 20:59:30 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbRoiLlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:59:30 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7927d8-758c-417f-8afa-c9adc39fcbf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:30 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[480601bf-fa8d-4e50-a05e-3d4eb5c56ba9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:31 user nova-compute[73476]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)
Aug 26 20:59:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:31 user nova-compute[73476]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 (non-flash)
Aug 26 20:59:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d4a577f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227'): ({'sdd'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Removing single pathed devices sdd {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d47d95-f7af-4ab4-9d36-da5eadf9dde3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[74197635-62b6-47df-be71-651564f39750]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Flushing IO for device /dev/sdd {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd6408-17a7-4f3a-98e1-40e2396e5e24]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30920f6-2e10-4b37-a31e-787ab9362c45]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aefb084-68f6-43e1-9339-cea159570d5d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff7c00-741d-4adf-8bf7-d75382ad9d22]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227, portal: 172.16.0.220,3260]
Aug 26 20:59:31 user nova-compute[73476]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227, portal: 172.16.0.220,3260] successful.
Aug 26 20:59:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f779043-76ba-4ff7-bc82-066e88836227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dea98fe-9a00-4573-944e-696babb99ad9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] <== disconnect_volume: return (278ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:59:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:59:32 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'flavor' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:59:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2b8db14e-c9dc-446f-88b2-4a72729ea04e tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:34 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:34 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'flavor' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:59:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e0ffafee-8e25-4f2e-9efa-81e440fe0692 tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.115s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'flavor' on Instance uuid 267a25c3-a5ab-4772-add0-33b854a44c23 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:35 user nova-compute[73476]: INFO nova.compute.manager [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Attaching volume 21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 to /dev/vdb
Aug 26 20:59:35 user nova-compute[73476]: DEBUG os_brick.utils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ecabcf-16ef-4b79-ad72-ca4d62857e21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb750468-51ba-4023-971b-32a22ebcb613]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.041s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b84724-d84f-4e7d-85db-70320e53cffd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce132335-6194-4fc7-b8d7-0f39cfe3e5f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 20:59:35 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c661c89-49c3-47f6-8420-305eb2c1dd1a]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG os_brick.utils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Updating existing volume attachment record: fe1243a7-814f-4c3f-80b5-7acc9f1560b5 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 20:59:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:39 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083564.624997, 1dddc689-a053-46d4-a29e-52c8fe78c76d => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 20:59:39 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] VM Stopped (Lifecycle Event)
Aug 26 20:59:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-ffbd1ee9-0712-495e-acf9-28294592f952 None None] [instance: 1dddc689-a053-46d4-a29e-52c8fe78c76d] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 20:59:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:45 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 20:59:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:59:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:59:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [{"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-8e964b8e-c28a-4f58-ad0e-d34212a36e42" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIJrUHLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:59:46 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:59:46 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:59:46 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[618eeeba-6bce-4a26-8fc8-10401782bb39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 20:59:46 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff357299-c59b-4e04-a046-5ed206ab597e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7] added
Aug 26 20:59:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd4e38a-2d20-4598-b54d-3755690635b4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d0a1f5-14cd-4b21-a0f7-931ae023d141]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIJrUHLC {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIJrUHLC" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[074cb6e6-0131-43bb-a9ae-19ac2517db94]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VIJrUHLC'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e41b427-2f93-4910-bd74-e44f1bb3a24f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dc685f-782f-438c-88c7-fd582de7b460]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[36315a56-f36e-44d2-99b9-3ce023ee62a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7, portal: 172.16.0.220,3260]
Aug 26 20:59:46 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7, portal: 172.16.0.220,3260] successful.
Aug 26 20:59:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aebf509-2bef-4f16-94f9-34ec54823a7e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307142c-9733-4e7b-b343-2c0b6bb0d6bf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:46 user nova-compute[73476]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 (non-flash)
Aug 26 20:59:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:46 user nova-compute[73476]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 (non-flash)
Aug 26 20:59:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21eba7c-13ef-4724-9b05-85270c555d45]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 20:59:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIJrUHLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23565383763636433', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565383763636433', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'flavor' on Instance uuid 267a25c3-a5ab-4772-add0-33b854a44c23 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:59:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 20:59:47 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:59:47 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 20:59:47 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:59:47 user nova-compute[73476]:   <serial>21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7</serial>
Aug 26 20:59:47 user nova-compute[73476]: </disk>
Aug 26 20:59:47 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:59:48 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=25.07030487060547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] No VIF found with MAC fa:16:3e:b9:ab:61, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance c2b05cbc-2666-4c5c-9a5b-be01236a1229 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 267a25c3-a5ab-4772-add0-33b854a44c23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1653254e-84f4-4a23-99d7-a24bbcd3743c tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.592s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:59:48 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:59:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 20:59:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:49 user nova-compute[73476]: INFO nova.compute.manager [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Detaching volume 21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7
Aug 26 20:59:49 user nova-compute[73476]: INFO nova.virt.block_device [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Attempting to driver detach volume 21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 from mountpoint /dev/vdb
Aug 26 20:59:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Attempting to detach device vdb from instance 267a25c3-a5ab-4772-add0-33b854a44c23 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 20:59:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:59:49 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:59:49 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 20:59:49 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:59:49 user nova-compute[73476]:   <serial>21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7</serial>
Aug 26 20:59:49 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:59:49 user nova-compute[73476]: </disk>
Aug 26 20:59:49 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:59:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully detached device vdb from instance 267a25c3-a5ab-4772-add0-33b854a44c23 from the persistent domain config.
Aug 26 20:59:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 267a25c3-a5ab-4772-add0-33b854a44c23 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 20:59:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 20:59:49 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 20:59:49 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 20:59:49 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 20:59:49 user nova-compute[73476]:   <serial>21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7</serial>
Aug 26 20:59:49 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 20:59:49 user nova-compute[73476]: </disk>
Aug 26 20:59:49 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 20:59:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083590.0500903, 267a25c3-a5ab-4772-add0-33b854a44c23 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 267a25c3-a5ab-4772-add0-33b854a44c23 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 20:59:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully detached device vdb from instance 267a25c3-a5ab-4772-add0-33b854a44c23 from the live domain config.
Aug 26 20:59:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIJrUHLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 20:59:50 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61920f6-1cb0-4d91-b77e-34900c39dc2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95b868-58fe-4937-bb9c-d5fd6c57a8d6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:50 user nova-compute[73476]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 (non-flash)
Aug 26 20:59:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 20:59:50 user nova-compute[73476]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 (non-flash)
Aug 26 20:59:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b01251b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[143f5ad8-98a5-4a0e-b43e-021eed23597a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cca407-2f06-4ce2-b3cf-42c0cd1af5c6]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0917a3-896d-428b-93de-d369984f474a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be15cc0-35cf-451d-9b68-c7be8700d13c]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5aac95-55eb-49f6-8969-be6015b958af]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5967fe8c-38ce-4e2f-9064-a1b6ef6a54cb]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7, portal: 172.16.0.220,3260]
Aug 26 20:59:50 user nova-compute[73476]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7, portal: 172.16.0.220,3260] successful.
Aug 26 20:59:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cb6f5d-ca06-4fa6-9a8e-12a90de95cd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[305d1670-27d0-41e5-9151-9441d1200eec]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] <== disconnect_volume: return (259ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 20:59:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 20:59:51 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'flavor' on Instance uuid 267a25c3-a5ab-4772-add0-33b854a44c23 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:59:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1ef9fdfc-8a48-4856-bf68-dc9ed973b1f7 tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.582s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 20:59:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 20:59:55 user nova-compute[73476]: INFO nova.compute.claims [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Claim successful on node user
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 20:59:55 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.policy [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6561f885aedc4f3babc29d0d887cebf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8898a711cbc44ce3927e58efdcc04106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 20:59:55 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Creating image(s)
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "/opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "/opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.175s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.169s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk 1073741824" returned: 0 in 0.051s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Successfully created port: a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Cannot resize image /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Ensure instance console log exists: /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Successfully updated port: a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquired lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d599d85-bf49-40e1-99c5-5800c1944c1b req-80e513b6-d68d-4a53-89e1-8da91d2276fa service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received event network-changed-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-4d599d85-bf49-40e1-99c5-5800c1944c1b req-80e513b6-d68d-4a53-89e1-8da91d2276fa service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Refreshing instance network info cache due to event network-changed-a96839e2-3a98-474c-801b-4fceb2bd2c56. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d599d85-bf49-40e1-99c5-5800c1944c1b req-80e513b6-d68d-4a53-89e1-8da91d2276fa service nova] Acquiring lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updating instance_info_cache with network_info: [{"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Releasing lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Instance network_info: |[{"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d599d85-bf49-40e1-99c5-5800c1944c1b req-80e513b6-d68d-4a53-89e1-8da91d2276fa service nova] Acquired lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.network.neutron [req-4d599d85-bf49-40e1-99c5-5800c1944c1b req-80e513b6-d68d-4a53-89e1-8da91d2276fa service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Refreshing network info cache for port a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Start _get_guest_xml network_info=[{"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 20:59:57 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:59:57 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-224101394',display_name='tempest-ServersNegativeTestJSON-server-224101394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-224101394',id=36,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8898a711cbc44ce3927e58efdcc04106',ramdisk_id='',reservation_id='r-x9tp39vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-969438150',owner_user_name='tempest-ServersNegativeTestJSON-969438150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:59:56Z,user_data=None,user_id='6561f885aedc4f3babc29d0d887cebf6',uuid=2ccfbf89-2c87-499b-b7c6-a8fd656cde37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converting VIF {"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3e:6f,bridge_name='br-int',has_traffic_filtering=True,id=a96839e2-3a98-474c-801b-4fceb2bd2c56,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa96839e2-3a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] End _get_guest_xml xml=<domain type="kvm">
Aug 26 20:59:57 user nova-compute[73476]:   <uuid>2ccfbf89-2c87-499b-b7c6-a8fd656cde37</uuid>
Aug 26 20:59:57 user nova-compute[73476]:   <name>instance-00000024</name>
Aug 26 20:59:57 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 20:59:57 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 20:59:57 user nova-compute[73476]:   <metadata>
Aug 26 20:59:57 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 20:59:57 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 20:59:57 user nova-compute[73476]:       <nova:name>tempest-ServersNegativeTestJSON-server-224101394</nova:name>
Aug 26 20:59:57 user nova-compute[73476]:       <nova:creationTime>2023-08-26 20:59:57</nova:creationTime>
Aug 26 20:59:57 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 20:59:57 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 20:59:57 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 20:59:57 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 20:59:57 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 20:59:57 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 20:59:57 user nova-compute[73476]:       </nova:flavor>
Aug 26 20:59:57 user nova-compute[73476]:       <nova:owner>
Aug 26 20:59:57 user nova-compute[73476]:         <nova:user uuid="6561f885aedc4f3babc29d0d887cebf6">tempest-ServersNegativeTestJSON-969438150-project-member</nova:user>
Aug 26 20:59:57 user nova-compute[73476]:         <nova:project uuid="8898a711cbc44ce3927e58efdcc04106">tempest-ServersNegativeTestJSON-969438150</nova:project>
Aug 26 20:59:57 user nova-compute[73476]:       </nova:owner>
Aug 26 20:59:57 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 20:59:57 user nova-compute[73476]:       <nova:ports>
Aug 26 20:59:57 user nova-compute[73476]:         <nova:port uuid="a96839e2-3a98-474c-801b-4fceb2bd2c56">
Aug 26 20:59:57 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 20:59:57 user nova-compute[73476]:         </nova:port>
Aug 26 20:59:57 user nova-compute[73476]:       </nova:ports>
Aug 26 20:59:57 user nova-compute[73476]:     </nova:instance>
Aug 26 20:59:57 user nova-compute[73476]:   </metadata>
Aug 26 20:59:57 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 20:59:57 user nova-compute[73476]:     <system>
Aug 26 20:59:57 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 20:59:57 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 20:59:57 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 20:59:57 user nova-compute[73476]:       <entry name="serial">2ccfbf89-2c87-499b-b7c6-a8fd656cde37</entry>
Aug 26 20:59:57 user nova-compute[73476]:       <entry name="uuid">2ccfbf89-2c87-499b-b7c6-a8fd656cde37</entry>
Aug 26 20:59:57 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 20:59:57 user nova-compute[73476]:     </system>
Aug 26 20:59:57 user nova-compute[73476]:   </sysinfo>
Aug 26 20:59:57 user nova-compute[73476]:   <os>
Aug 26 20:59:57 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 20:59:57 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 20:59:57 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 20:59:57 user nova-compute[73476]:   </os>
Aug 26 20:59:57 user nova-compute[73476]:   <features>
Aug 26 20:59:57 user nova-compute[73476]:     <acpi/>
Aug 26 20:59:57 user nova-compute[73476]:     <apic/>
Aug 26 20:59:57 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 20:59:57 user nova-compute[73476]:   </features>
Aug 26 20:59:57 user nova-compute[73476]:   <clock offset="utc">
Aug 26 20:59:57 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 20:59:57 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 20:59:57 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 20:59:57 user nova-compute[73476]:   </clock>
Aug 26 20:59:57 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 20:59:57 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 20:59:57 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 20:59:57 user nova-compute[73476]:   </cpu>
Aug 26 20:59:57 user nova-compute[73476]:   <devices>
Aug 26 20:59:57 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 20:59:57 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 20:59:57 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk"/>
Aug 26 20:59:57 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 20:59:57 user nova-compute[73476]:     </disk>
Aug 26 20:59:57 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 20:59:57 user nova-compute[73476]:       <mac address="fa:16:3e:c7:3e:6f"/>
Aug 26 20:59:57 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:59:57 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 20:59:57 user nova-compute[73476]:       <target dev="tapa96839e2-3a"/>
Aug 26 20:59:57 user nova-compute[73476]:     </interface>
Aug 26 20:59:57 user nova-compute[73476]:     <serial type="pty">
Aug 26 20:59:57 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/console.log" append="off"/>
Aug 26 20:59:57 user nova-compute[73476]:     </serial>
Aug 26 20:59:57 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 20:59:57 user nova-compute[73476]:     <video>
Aug 26 20:59:57 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 20:59:57 user nova-compute[73476]:     </video>
Aug 26 20:59:57 user nova-compute[73476]:     <rng model="virtio">
Aug 26 20:59:57 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 20:59:57 user nova-compute[73476]:     </rng>
Aug 26 20:59:57 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 20:59:57 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 20:59:57 user nova-compute[73476]:       <stats period="10"/>
Aug 26 20:59:57 user nova-compute[73476]:     </memballoon>
Aug 26 20:59:57 user nova-compute[73476]:   </devices>
Aug 26 20:59:57 user nova-compute[73476]: </domain>
Aug 26 20:59:57 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-224101394',display_name='tempest-ServersNegativeTestJSON-server-224101394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-224101394',id=36,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8898a711cbc44ce3927e58efdcc04106',ramdisk_id='',reservation_id='r-x9tp39vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-969438150',owner_user_name='tempest-ServersNegativeTestJSON-969438150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T20:59:56Z,user_data=None,user_id='6561f885aedc4f3babc29d0d887cebf6',uuid=2ccfbf89-2c87-499b-b7c6-a8fd656cde37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converting VIF {"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3e:6f,bridge_name='br-int',has_traffic_filtering=True,id=a96839e2-3a98-474c-801b-4fceb2bd2c56,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa96839e2-3a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG os_vif [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3e:6f,bridge_name='br-int',has_traffic_filtering=True,id=a96839e2-3a98-474c-801b-4fceb2bd2c56,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa96839e2-3a') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa96839e2-3a, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa96839e2-3a, col_values=(('external_ids', {'iface-id': 'a96839e2-3a98-474c-801b-4fceb2bd2c56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:3e:6f', 'vm-uuid': '2ccfbf89-2c87-499b-b7c6-a8fd656cde37'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:57 user nova-compute[73476]: INFO os_vif [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3e:6f,bridge_name='br-int',has_traffic_filtering=True,id=a96839e2-3a98-474c-801b-4fceb2bd2c56,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa96839e2-3a')
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 20:59:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] No VIF found with MAC fa:16:3e:c7:3e:6f, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 20:59:58 user nova-compute[73476]: DEBUG nova.network.neutron [req-4d599d85-bf49-40e1-99c5-5800c1944c1b req-80e513b6-d68d-4a53-89e1-8da91d2276fa service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updated VIF entry in instance network info cache for port a96839e2-3a98-474c-801b-4fceb2bd2c56. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 20:59:58 user nova-compute[73476]: DEBUG nova.network.neutron [req-4d599d85-bf49-40e1-99c5-5800c1944c1b req-80e513b6-d68d-4a53-89e1-8da91d2276fa service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updating instance_info_cache with network_info: [{"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 20:59:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4d599d85-bf49-40e1-99c5-5800c1944c1b req-80e513b6-d68d-4a53-89e1-8da91d2276fa service nova] Releasing lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-a4851be9-b367-469d-aab9-96c0f38aa689 req-db3b4f9a-ae57-4af3-900d-76efcce9a27f service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received event network-vif-plugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a4851be9-b367-469d-aab9-96c0f38aa689 req-db3b4f9a-ae57-4af3-900d-76efcce9a27f service nova] Acquiring lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a4851be9-b367-469d-aab9-96c0f38aa689 req-db3b4f9a-ae57-4af3-900d-76efcce9a27f service nova] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a4851be9-b367-469d-aab9-96c0f38aa689 req-db3b4f9a-ae57-4af3-900d-76efcce9a27f service nova] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-a4851be9-b367-469d-aab9-96c0f38aa689 req-db3b4f9a-ae57-4af3-900d-76efcce9a27f service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] No waiting events found dispatching network-vif-plugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 20:59:59 user nova-compute[73476]: WARNING nova.compute.manager [req-a4851be9-b367-469d-aab9-96c0f38aa689 req-db3b4f9a-ae57-4af3-900d-76efcce9a27f service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received unexpected event network-vif-plugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 for instance with vm_state building and task_state spawning.
Aug 26 20:59:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 20:59:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083601.3178372, 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:00:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] VM Resumed (Lifecycle Event)
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:00:01 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Instance spawned successfully.
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:00:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083601.3243685, 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:00:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] VM Started (Lifecycle Event)
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:00:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b49cf3b1-bfb1-45c5-af99-79898dde3bf2 req-7d057b4d-c2ac-488e-beb8-37320b4ddcde service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received event network-vif-plugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b49cf3b1-bfb1-45c5-af99-79898dde3bf2 req-7d057b4d-c2ac-488e-beb8-37320b4ddcde service nova] Acquiring lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b49cf3b1-bfb1-45c5-af99-79898dde3bf2 req-7d057b4d-c2ac-488e-beb8-37320b4ddcde service nova] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b49cf3b1-bfb1-45c5-af99-79898dde3bf2 req-7d057b4d-c2ac-488e-beb8-37320b4ddcde service nova] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-b49cf3b1-bfb1-45c5-af99-79898dde3bf2 req-7d057b4d-c2ac-488e-beb8-37320b4ddcde service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] No waiting events found dispatching network-vif-plugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:00:01 user nova-compute[73476]: WARNING nova.compute.manager [req-b49cf3b1-bfb1-45c5-af99-79898dde3bf2 req-7d057b4d-c2ac-488e-beb8-37320b4ddcde service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received unexpected event network-vif-plugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 for instance with vm_state building and task_state spawning.
Aug 26 21:00:01 user nova-compute[73476]: INFO nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 26 21:00:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:00:01 user nova-compute[73476]: INFO nova.compute.manager [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Took 6.45 seconds to build instance.
Aug 26 21:00:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e66fab84-1978-4a26-a34c-5690c8aa1eb2 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.649s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:14 user nova-compute[73476]: INFO nova.compute.manager [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Terminating instance
Aug 26 21:00:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:00:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-1755e1d1-1051-4179-983e-9502d3db208d req-6c3582f3-1a68-4f32-bddf-923822c5a2a4 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1755e1d1-1051-4179-983e-9502d3db208d req-6c3582f3-1a68-4f32-bddf-923822c5a2a4 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1755e1d1-1051-4179-983e-9502d3db208d req-6c3582f3-1a68-4f32-bddf-923822c5a2a4 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1755e1d1-1051-4179-983e-9502d3db208d req-6c3582f3-1a68-4f32-bddf-923822c5a2a4 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-1755e1d1-1051-4179-983e-9502d3db208d req-6c3582f3-1a68-4f32-bddf-923822c5a2a4 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-1755e1d1-1051-4179-983e-9502d3db208d req-6c3582f3-1a68-4f32-bddf-923822c5a2a4 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-unplugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:00:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Instance destroyed successfully.
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'resources' on Instance uuid c2b05cbc-2666-4c5c-9a5b-be01236a1229 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-495477562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-495477562',id=12,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-w4u5mw1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:48:15Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=c2b05cbc-2666-4c5c-9a5b-be01236a1229,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "address": "fa:16:3e:47:43:db", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51ff675-db", "ovs_interfaceid": "b51ff675-dbca-4a11-8ed4-a7040a20f850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:43:db,bridge_name='br-int',has_traffic_filtering=True,id=b51ff675-dbca-4a11-8ed4-a7040a20f850,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51ff675-db') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_vif [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:43:db,bridge_name='br-int',has_traffic_filtering=True,id=b51ff675-dbca-4a11-8ed4-a7040a20f850,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51ff675-db') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb51ff675-db, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:00:15 user nova-compute[73476]: INFO os_vif [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:43:db,bridge_name='br-int',has_traffic_filtering=True,id=b51ff675-dbca-4a11-8ed4-a7040a20f850,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51ff675-db')
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCIXAPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:00:15 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8015e1-7416-40ac-a6c6-20aa8322120e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a703718c-e89b-4397-a022-e342ea2876db]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 21:00:15 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa (non-flash)
Aug 26 21:00:15 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02de440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa'): ({'sdh'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Removing single pathed devices sdh {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3557a-fc42-4fe3-8198-333587172afe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0f556c-2a40-4949-91c3-afe5bcb7ef02]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Flushing IO for device /dev/sdh {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b53c24-cebb-46c0-b2d2-49a5ffeaec2d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bb4bce-8dc2-49dd-9f50-053d609fea6e]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] SCSI volumes sdh have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98ed497-6a67-40a2-aa09-b03ad1206706]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[688e3c99-1d93-4125-a236-fb72dee15664]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa, portal: 172.16.0.220,3260]
Aug 26 21:00:15 user nova-compute[73476]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa, portal: 172.16.0.220,3260] successful.
Aug 26 21:00:15 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d3039c3-ff22-49e9-ab6d-92cf18b8b3fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e38c75-e0fe-43b7-8b7e-00c4f93eec0e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] <== disconnect_volume: return (266ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:00:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Deleting instance files /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229_del
Aug 26 21:00:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Deletion of /opt/stack/data/nova/instances/c2b05cbc-2666-4c5c-9a5b-be01236a1229_del complete
Aug 26 21:00:15 user nova-compute[73476]: INFO nova.compute.manager [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 26 21:00:15 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:00:15 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:00:16 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:00:16 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Took 1.17 seconds to deallocate network for instance.
Aug 26 21:00:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-7b0285df-0e89-4fdc-9553-2179cd4f9abd req-b31a3ac5-b59d-4540-882c-220ace799488 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-deleted-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-f9c37f95-e0e6-4e83-ae35-81d5f474ec32 req-c58d2e58-acb4-40af-b595-a344244bf753 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f9c37f95-e0e6-4e83-ae35-81d5f474ec32 req-c58d2e58-acb4-40af-b595-a344244bf753 service nova] Acquiring lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f9c37f95-e0e6-4e83-ae35-81d5f474ec32 req-c58d2e58-acb4-40af-b595-a344244bf753 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f9c37f95-e0e6-4e83-ae35-81d5f474ec32 req-c58d2e58-acb4-40af-b595-a344244bf753 service nova] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-f9c37f95-e0e6-4e83-ae35-81d5f474ec32 req-c58d2e58-acb4-40af-b595-a344244bf753 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] No waiting events found dispatching network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:00:17 user nova-compute[73476]: WARNING nova.compute.manager [req-f9c37f95-e0e6-4e83-ae35-81d5f474ec32 req-c58d2e58-acb4-40af-b595-a344244bf753 service nova] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Received unexpected event network-vif-plugged-b51ff675-dbca-4a11-8ed4-a7040a20f850 for instance with vm_state active and task_state deleting.
Aug 26 21:00:17 user nova-compute[73476]: INFO nova.compute.manager [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Took 0.78 seconds to detach 1 volumes for instance.
Aug 26 21:00:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:17 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:00:17 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:00:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:17 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Deleted allocations for instance c2b05cbc-2666-4c5c-9a5b-be01236a1229
Aug 26 21:00:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c5d8457-bd0a-4d68-892f-c6483b11f4ac tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "c2b05cbc-2666-4c5c-9a5b-be01236a1229" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.528s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:20 user nova-compute[73476]: INFO nova.compute.manager [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Terminating instance
Aug 26 21:00:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-7facde52-8e2b-457b-b08c-4b2193a1463b req-0735c07d-4432-4e44-9fa7-f3e762edf382 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7facde52-8e2b-457b-b08c-4b2193a1463b req-0735c07d-4432-4e44-9fa7-f3e762edf382 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7facde52-8e2b-457b-b08c-4b2193a1463b req-0735c07d-4432-4e44-9fa7-f3e762edf382 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7facde52-8e2b-457b-b08c-4b2193a1463b req-0735c07d-4432-4e44-9fa7-f3e762edf382 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-7facde52-8e2b-457b-b08c-4b2193a1463b req-0735c07d-4432-4e44-9fa7-f3e762edf382 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-7facde52-8e2b-457b-b08c-4b2193a1463b req-0735c07d-4432-4e44-9fa7-f3e762edf382 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-unplugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:20 user nova-compute[73476]: INFO nova.compute.manager [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Terminating instance
Aug 26 21:00:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Instance destroyed successfully.
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lazy-loading 'resources' on Instance uuid 8e964b8e-c28a-4f58-ad0e-d34212a36e42 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1499031467',display_name='tempest-ServerStableDeviceRescueTest-server-1499031467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1499031467',id=28,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDawYycI76NkUKDRLbP9/BjRPLtgnBqjfQHAVSnC1A7iy3vv3tmWNE5+ydF0i5dZv7RrDZE5nZ7ua+6pZvputBnQRMIV1Od9pG1QQu6/dSZ8ykQv+vGnHBn6EvuJACGwCA==',key_name='tempest-keypair-1844255857',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:57:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8203758c21c944a3b6412f96d7e55246',ramdisk_id='',reservation_id='r-4bx0u0o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1046559965',owner_user_name='tempest-ServerStableDeviceRescueTest-1046559965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d92c80cbcec44e1db0b0838e2574222a',uuid=8e964b8e-c28a-4f58-ad0e-d34212a36e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Converting VIF {"id": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "address": "fa:16:3e:04:f8:66", "network": {"id": "fb47d1e5-3099-46c3-8c85-029b18700b5e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-278486845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8203758c21c944a3b6412f96d7e55246", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbe332d-e9", "ovs_interfaceid": "4fbe332d-e987-48c7-9ddf-94e0e0427864", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:f8:66,bridge_name='br-int',has_traffic_filtering=True,id=4fbe332d-e987-48c7-9ddf-94e0e0427864,network=Network(fb47d1e5-3099-46c3-8c85-029b18700b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbe332d-e9') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG os_vif [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f8:66,bridge_name='br-int',has_traffic_filtering=True,id=4fbe332d-e987-48c7-9ddf-94e0e0427864,network=Network(fb47d1e5-3099-46c3-8c85-029b18700b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbe332d-e9') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fbe332d-e9, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:21 user nova-compute[73476]: INFO os_vif [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f8:66,bridge_name='br-int',has_traffic_filtering=True,id=4fbe332d-e987-48c7-9ddf-94e0e0427864,network=Network(fb47d1e5-3099-46c3-8c85-029b18700b5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbe332d-e9')
Aug 26 21:00:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Deleting instance files /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42_del
Aug 26 21:00:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Deletion of /opt/stack/data/nova/instances/8e964b8e-c28a-4f58-ad0e-d34212a36e42_del complete
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-43594ddd-7859-4fd5-8c23-0fa30b146588 req-2e277a80-15e2-4ba9-b083-24cf31707803 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-unplugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-43594ddd-7859-4fd5-8c23-0fa30b146588 req-2e277a80-15e2-4ba9-b083-24cf31707803 service nova] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-43594ddd-7859-4fd5-8c23-0fa30b146588 req-2e277a80-15e2-4ba9-b083-24cf31707803 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-43594ddd-7859-4fd5-8c23-0fa30b146588 req-2e277a80-15e2-4ba9-b083-24cf31707803 service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-43594ddd-7859-4fd5-8c23-0fa30b146588 req-2e277a80-15e2-4ba9-b083-24cf31707803 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] No waiting events found dispatching network-vif-unplugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-43594ddd-7859-4fd5-8c23-0fa30b146588 req-2e277a80-15e2-4ba9-b083-24cf31707803 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-unplugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:00:21 user nova-compute[73476]: INFO nova.compute.manager [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 21:00:21 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Instance destroyed successfully.
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'resources' on Instance uuid 4fdf4aae-7ecd-448a-974d-56ff46abd39a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T20:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1749490198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1749490198',id=32,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENYUdp9PpxnlBViq6RckJL4WVsGonAfQOV+tESM+2KUxv9mCIOfNWZgsfuu2Du6Q2DPctsZfXI/n6oQ7xLntfwWy4lyF0e1opIpDGuNToQE+SfJAFfeXDiXhMnu/kapFg==',key_name='tempest-keypair-2072190721',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:58:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-alt09urc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=4fdf4aae-7ecd-448a-974d-56ff46abd39a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "address": "fa:16:3e:6d:f5:96", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6584605e-81", "ovs_interfaceid": "6584605e-8134-4b8a-823b-c7fa91e9edf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG os_vif [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6584605e-81, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:00:21 user nova-compute[73476]: INFO os_vif [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:96,bridge_name='br-int',has_traffic_filtering=True,id=6584605e-8134-4b8a-823b-c7fa91e9edf2,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6584605e-81')
Aug 26 21:00:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Deleting instance files /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a_del
Aug 26 21:00:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Deletion of /opt/stack/data/nova/instances/4fdf4aae-7ecd-448a-974d-56ff46abd39a_del complete
Aug 26 21:00:21 user nova-compute[73476]: INFO nova.compute.manager [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 21:00:21 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:00:21 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-a6173954-db03-4e67-a129-d9b6abbeb977 req-5598536b-4505-44ac-b0b9-0396f680da75 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a6173954-db03-4e67-a129-d9b6abbeb977 req-5598536b-4505-44ac-b0b9-0396f680da75 service nova] Acquiring lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a6173954-db03-4e67-a129-d9b6abbeb977 req-5598536b-4505-44ac-b0b9-0396f680da75 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a6173954-db03-4e67-a129-d9b6abbeb977 req-5598536b-4505-44ac-b0b9-0396f680da75 service nova] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-a6173954-db03-4e67-a129-d9b6abbeb977 req-5598536b-4505-44ac-b0b9-0396f680da75 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] No waiting events found dispatching network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:00:22 user nova-compute[73476]: WARNING nova.compute.manager [req-a6173954-db03-4e67-a129-d9b6abbeb977 req-5598536b-4505-44ac-b0b9-0396f680da75 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received unexpected event network-vif-plugged-4fbe332d-e987-48c7-9ddf-94e0e0427864 for instance with vm_state active and task_state deleting.
Aug 26 21:00:22 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:00:22 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Took 1.54 seconds to deallocate network for instance.
Aug 26 21:00:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-acc827be-c38b-4ac9-ade3-9ecb1b460bb1 req-d5d8522d-8f4e-4543-955d-a60bd4662ab8 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Received event network-vif-deleted-4fbe332d-e987-48c7-9ddf-94e0e0427864 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:22 user nova-compute[73476]: INFO nova.compute.manager [req-acc827be-c38b-4ac9-ade3-9ecb1b460bb1 req-d5d8522d-8f4e-4543-955d-a60bd4662ab8 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Neutron deleted interface 4fbe332d-e987-48c7-9ddf-94e0e0427864; detaching it from the instance and deleting it from the info cache
Aug 26 21:00:22 user nova-compute[73476]: DEBUG nova.network.neutron [req-acc827be-c38b-4ac9-ade3-9ecb1b460bb1 req-d5d8522d-8f4e-4543-955d-a60bd4662ab8 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-acc827be-c38b-4ac9-ade3-9ecb1b460bb1 req-d5d8522d-8f4e-4543-955d-a60bd4662ab8 service nova] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Detach interface failed, port_id=4fbe332d-e987-48c7-9ddf-94e0e0427864, reason: Instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42 could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:00:22 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:23 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Deleted allocations for instance 8e964b8e-c28a-4f58-ad0e-d34212a36e42
Aug 26 21:00:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e08df268-fbb7-4e4f-98bf-b10e1aa90e0d tempest-ServerStableDeviceRescueTest-1046559965 tempest-ServerStableDeviceRescueTest-1046559965-project-member] Lock "8e964b8e-c28a-4f58-ad0e-d34212a36e42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-de19cd3f-e0a0-45d8-bac7-feef41fefcb0 req-0c2c7545-29cd-446c-984d-90b5039516fd service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-de19cd3f-e0a0-45d8-bac7-feef41fefcb0 req-0c2c7545-29cd-446c-984d-90b5039516fd service nova] Acquiring lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-de19cd3f-e0a0-45d8-bac7-feef41fefcb0 req-0c2c7545-29cd-446c-984d-90b5039516fd service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-de19cd3f-e0a0-45d8-bac7-feef41fefcb0 req-0c2c7545-29cd-446c-984d-90b5039516fd service nova] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-de19cd3f-e0a0-45d8-bac7-feef41fefcb0 req-0c2c7545-29cd-446c-984d-90b5039516fd service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] No waiting events found dispatching network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:00:23 user nova-compute[73476]: WARNING nova.compute.manager [req-de19cd3f-e0a0-45d8-bac7-feef41fefcb0 req-0c2c7545-29cd-446c-984d-90b5039516fd service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received unexpected event network-vif-plugged-6584605e-8134-4b8a-823b-c7fa91e9edf2 for instance with vm_state active and task_state deleting.
Aug 26 21:00:23 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:00:23 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Took 1.59 seconds to deallocate network for instance.
Aug 26 21:00:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:00:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:23 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Deleted allocations for instance 4fdf4aae-7ecd-448a-974d-56ff46abd39a
Aug 26 21:00:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-35797080-16be-4cd7-aba7-a3649dce098a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "4fdf4aae-7ecd-448a-974d-56ff46abd39a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.861s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:24 user nova-compute[73476]: DEBUG nova.compute.manager [req-523a66d3-9d0c-498b-9b58-05b44c70b3d7 req-47d40821-f3ce-43e1-bf79-059ce26b6b93 service nova] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Received event network-vif-deleted-6584605e-8134-4b8a-823b-c7fa91e9edf2 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:30 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083615.2760563, c2b05cbc-2666-4c5c-9a5b-be01236a1229 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:00:30 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] VM Stopped (Lifecycle Event)
Aug 26 21:00:30 user nova-compute[73476]: DEBUG nova.compute.manager [None req-de025ca3-8eb1-4357-ad01-959df238a027 None None] [instance: c2b05cbc-2666-4c5c-9a5b-be01236a1229] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:00:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:00:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:00:35 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083620.991423, 8e964b8e-c28a-4f58-ad0e-d34212a36e42 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:00:35 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] VM Stopped (Lifecycle Event)
Aug 26 21:00:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d476137d-6b90-4594-b6ac-a11d0754e45e None None] [instance: 8e964b8e-c28a-4f58-ad0e-d34212a36e42] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:00:36 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083621.6343048, 4fdf4aae-7ecd-448a-974d-56ff46abd39a => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:00:36 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] VM Stopped (Lifecycle Event)
Aug 26 21:00:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4afccbf4-6366-44e9-a925-25fa7494344a None None] [instance: 4fdf4aae-7ecd-448a-974d-56ff46abd39a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:00:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:36 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:00:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:00:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:00:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:39 user nova-compute[73476]: INFO nova.compute.manager [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Terminating instance
Aug 26 21:00:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:00:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-47aa541b-a7d9-4870-87ab-0ecd4f6c6068 req-b96093eb-bc85-4756-bdda-38826f656ea8 service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received event network-vif-unplugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-47aa541b-a7d9-4870-87ab-0ecd4f6c6068 req-b96093eb-bc85-4756-bdda-38826f656ea8 service nova] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-47aa541b-a7d9-4870-87ab-0ecd4f6c6068 req-b96093eb-bc85-4756-bdda-38826f656ea8 service nova] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-47aa541b-a7d9-4870-87ab-0ecd4f6c6068 req-b96093eb-bc85-4756-bdda-38826f656ea8 service nova] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-47aa541b-a7d9-4870-87ab-0ecd4f6c6068 req-b96093eb-bc85-4756-bdda-38826f656ea8 service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] No waiting events found dispatching network-vif-unplugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-47aa541b-a7d9-4870-87ab-0ecd4f6c6068 req-b96093eb-bc85-4756-bdda-38826f656ea8 service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received event network-vif-unplugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:00:40 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Instance destroyed successfully.
Aug 26 21:00:40 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lazy-loading 'resources' on Instance uuid 267a25c3-a5ab-4772-add0-33b854a44c23 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-460471589',display_name='tempest-AttachVolumeNegativeTest-server-460471589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-460471589',id=35,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK/YKMn5DCyucDgLctxtgKDkiILiQRgiT3jJ8z5v3jarrdvmn1SST4I2wphTX/pLT7YW1ZLLB6ZqPZZIb3MY3tOtJNKMheZWYc4+zJjjKUxRUBFbDHr42GZKxutBQUe/Q==',key_name='tempest-keypair-487381580',keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:57:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98519bcea11642e6b491b3a0cb4616db',ramdisk_id='',reservation_id='r-wmlnvkcm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-745835648',owner_user_name='tempest-AttachVolumeNegativeTest-745835648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd8ed063c144eb694017e5750ee57a9',uuid=267a25c3-a5ab-4772-add0-33b854a44c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converting VIF {"id": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "address": "fa:16:3e:b9:ab:61", "network": {"id": "b017b931-3400-40ee-8ff1-2253e8f594ce", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-159491142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98519bcea11642e6b491b3a0cb4616db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ff021-f7", "ovs_interfaceid": "391ff021-f70e-4a2d-99dc-554838d9a3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:ab:61,bridge_name='br-int',has_traffic_filtering=True,id=391ff021-f70e-4a2d-99dc-554838d9a3c1,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ff021-f7') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG os_vif [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:ab:61,bridge_name='br-int',has_traffic_filtering=True,id=391ff021-f70e-4a2d-99dc-554838d9a3c1,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ff021-f7') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap391ff021-f7, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:00:40 user nova-compute[73476]: INFO os_vif [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:ab:61,bridge_name='br-int',has_traffic_filtering=True,id=391ff021-f70e-4a2d-99dc-554838d9a3c1,network=Network(b017b931-3400-40ee-8ff1-2253e8f594ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ff021-f7')
Aug 26 21:00:40 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Deleting instance files /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23_del
Aug 26 21:00:40 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Deletion of /opt/stack/data/nova/instances/267a25c3-a5ab-4772-add0-33b854a44c23_del complete
Aug 26 21:00:40 user nova-compute[73476]: INFO nova.compute.manager [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 21:00:40 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:00:40 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:00:41 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:00:41 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Took 0.91 seconds to deallocate network for instance.
Aug 26 21:00:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:41 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:00:41 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:00:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:41 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Deleted allocations for instance 267a25c3-a5ab-4772-add0-33b854a44c23
Aug 26 21:00:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9032af06-7311-41b3-aa73-b88213e89d7b tempest-AttachVolumeNegativeTest-745835648 tempest-AttachVolumeNegativeTest-745835648-project-member] Lock "267a25c3-a5ab-4772-add0-33b854a44c23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:42 user nova-compute[73476]: DEBUG nova.compute.manager [req-0cb20146-24c7-44db-96a8-4d75015317c5 req-179725da-b8e3-4277-b25c-86d3616bc61d service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received event network-vif-plugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0cb20146-24c7-44db-96a8-4d75015317c5 req-179725da-b8e3-4277-b25c-86d3616bc61d service nova] Acquiring lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0cb20146-24c7-44db-96a8-4d75015317c5 req-179725da-b8e3-4277-b25c-86d3616bc61d service nova] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0cb20146-24c7-44db-96a8-4d75015317c5 req-179725da-b8e3-4277-b25c-86d3616bc61d service nova] Lock "267a25c3-a5ab-4772-add0-33b854a44c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:42 user nova-compute[73476]: DEBUG nova.compute.manager [req-0cb20146-24c7-44db-96a8-4d75015317c5 req-179725da-b8e3-4277-b25c-86d3616bc61d service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] No waiting events found dispatching network-vif-plugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:00:42 user nova-compute[73476]: WARNING nova.compute.manager [req-0cb20146-24c7-44db-96a8-4d75015317c5 req-179725da-b8e3-4277-b25c-86d3616bc61d service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received unexpected event network-vif-plugged-391ff021-f70e-4a2d-99dc-554838d9a3c1 for instance with vm_state deleted and task_state None.
Aug 26 21:00:42 user nova-compute[73476]: DEBUG nova.compute.manager [req-0cb20146-24c7-44db-96a8-4d75015317c5 req-179725da-b8e3-4277-b25c-86d3616bc61d service nova] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Received event network-vif-deleted-391ff021-f70e-4a2d-99dc-554838d9a3c1 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:00:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:00:44 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:00:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:00:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:00:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:00:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:00:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:00:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:47 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:00:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:00:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:00:49 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:00:49 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:00:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8449MB free_disk=25.212005615234375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 22b50300-8865-4854-b0c7-ed63ca60c85b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:00:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:00:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:00:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:00:55 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083640.6251905, 267a25c3-a5ab-4772-add0-33b854a44c23 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:00:55 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] VM Stopped (Lifecycle Event)
Aug 26 21:00:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-64321c43-3437-4838-b3f0-5974ce165b98 None None] [instance: 267a25c3-a5ab-4772-add0-33b854a44c23] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:00:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "22b50300-8865-4854-b0c7-ed63ca60c85b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:05 user nova-compute[73476]: INFO nova.compute.manager [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Terminating instance
Aug 26 21:01:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4562343-cfdf-4523-a310-653d1f5ce3f9 req-1f5aa7b2-1f34-4d2f-a884-29b481794d3d service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received event network-vif-unplugged-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4562343-cfdf-4523-a310-653d1f5ce3f9 req-1f5aa7b2-1f34-4d2f-a884-29b481794d3d service nova] Acquiring lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4562343-cfdf-4523-a310-653d1f5ce3f9 req-1f5aa7b2-1f34-4d2f-a884-29b481794d3d service nova] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f4562343-cfdf-4523-a310-653d1f5ce3f9 req-1f5aa7b2-1f34-4d2f-a884-29b481794d3d service nova] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4562343-cfdf-4523-a310-653d1f5ce3f9 req-1f5aa7b2-1f34-4d2f-a884-29b481794d3d service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] No waiting events found dispatching network-vif-unplugged-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-f4562343-cfdf-4523-a310-653d1f5ce3f9 req-1f5aa7b2-1f34-4d2f-a884-29b481794d3d service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received event network-vif-unplugged-27627bb2-3a27-4437-942f-3d72af60aad3 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Instance destroyed successfully.
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.objects.instance [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lazy-loading 'resources' on Instance uuid 22b50300-8865-4854-b0c7-ed63ca60c85b {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-443158251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-443158251',id=1,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T20:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679727d63ba04ad48740d1b967be5a61',ramdisk_id='',reservation_id='r-0ixuoad0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-735166680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T20:43:23Z,user_data=None,user_id='5ed2a98f37294fd381fd1dfe7c5c0751',uuid=22b50300-8865-4854-b0c7-ed63ca60c85b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converting VIF {"id": "27627bb2-3a27-4437-942f-3d72af60aad3", "address": "fa:16:3e:66:b8:59", "network": {"id": "d2877499-7cb7-471c-9363-9ccee690bfac", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1920991419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679727d63ba04ad48740d1b967be5a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27627bb2-3a", "ovs_interfaceid": "27627bb2-3a27-4437-942f-3d72af60aad3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:b8:59,bridge_name='br-int',has_traffic_filtering=True,id=27627bb2-3a27-4437-942f-3d72af60aad3,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27627bb2-3a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG os_vif [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:b8:59,bridge_name='br-int',has_traffic_filtering=True,id=27627bb2-3a27-4437-942f-3d72af60aad3,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27627bb2-3a') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27627bb2-3a, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:01:06 user nova-compute[73476]: INFO os_vif [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:b8:59,bridge_name='br-int',has_traffic_filtering=True,id=27627bb2-3a27-4437-942f-3d72af60aad3,network=Network(d2877499-7cb7-471c-9363-9ccee690bfac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27627bb2-3a')
Aug 26 21:01:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Deleting instance files /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b_del
Aug 26 21:01:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Deletion of /opt/stack/data/nova/instances/22b50300-8865-4854-b0c7-ed63ca60c85b_del complete
Aug 26 21:01:06 user nova-compute[73476]: INFO nova.compute.manager [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 26 21:01:06 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:06 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Took 0.52 seconds to deallocate network for instance.
Aug 26 21:01:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-159b9ed1-49e4-4b58-b480-e5c919581913 req-f155dc44-f13f-42e6-91a0-e1a47f68e542 service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received event network-vif-deleted-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:07 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:01:07 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:01:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:07 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Deleted allocations for instance 22b50300-8865-4854-b0c7-ed63ca60c85b
Aug 26 21:01:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-804752f4-4e5b-42bd-b9b1-58c370fd2254 tempest-ServerBootFromVolumeStableRescueTest-735166680 tempest-ServerBootFromVolumeStableRescueTest-735166680-project-member] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.629s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-b6a66080-72ff-431d-8909-09e69c5564f4 req-411f6d9f-fa65-417a-aa38-35010746efdc service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received event network-vif-plugged-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b6a66080-72ff-431d-8909-09e69c5564f4 req-411f6d9f-fa65-417a-aa38-35010746efdc service nova] Acquiring lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b6a66080-72ff-431d-8909-09e69c5564f4 req-411f6d9f-fa65-417a-aa38-35010746efdc service nova] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b6a66080-72ff-431d-8909-09e69c5564f4 req-411f6d9f-fa65-417a-aa38-35010746efdc service nova] Lock "22b50300-8865-4854-b0c7-ed63ca60c85b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-b6a66080-72ff-431d-8909-09e69c5564f4 req-411f6d9f-fa65-417a-aa38-35010746efdc service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] No waiting events found dispatching network-vif-plugged-27627bb2-3a27-4437-942f-3d72af60aad3 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:08 user nova-compute[73476]: WARNING nova.compute.manager [req-b6a66080-72ff-431d-8909-09e69c5564f4 req-411f6d9f-fa65-417a-aa38-35010746efdc service nova] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Received unexpected event network-vif-plugged-27627bb2-3a27-4437-942f-3d72af60aad3 for instance with vm_state deleted and task_state None.
Aug 26 21:01:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:01:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:14 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:01:14 user nova-compute[73476]: INFO nova.compute.claims [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Claim successful on node user
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:01:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.policy [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23d582475c914098b5c6dce6268c2e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fdd3e8e61d47bd8a50affae1854448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:01:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Creating image(s)
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk 1073741824" returned: 0 in 0.064s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:01:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Successfully created port: 525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Cannot resize image /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Ensure instance console log exists: /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Successfully updated port: 525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquired lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-d59b7381-d861-411c-8eea-475be9642098 req-d8ee5c70-321c-4ec1-ba5b-61963dd094c6 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-changed-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-d59b7381-d861-411c-8eea-475be9642098 req-d8ee5c70-321c-4ec1-ba5b-61963dd094c6 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Refreshing instance network info cache due to event network-changed-525b5d65-8ad1-445d-aa94-091fe68cbc0f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d59b7381-d861-411c-8eea-475be9642098 req-d8ee5c70-321c-4ec1-ba5b-61963dd094c6 service nova] Acquiring lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating instance_info_cache with network_info: [{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Releasing lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance network_info: |[{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d59b7381-d861-411c-8eea-475be9642098 req-d8ee5c70-321c-4ec1-ba5b-61963dd094c6 service nova] Acquired lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.network.neutron [req-d59b7381-d861-411c-8eea-475be9642098 req-d8ee5c70-321c-4ec1-ba5b-61963dd094c6 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Refreshing network info cache for port 525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Start _get_guest_xml network_info=[{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:01:17 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:17 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:01:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-891897880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-891897880',id=37,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkKX5RWHWnNaFPRwccSTJZClKfJCvxst9NrrwQIMgyEW01AEls4K3rtrSmyQitd/fHtBfBqYkZ8HNxZQAuEcfvKwbMHrWqgyAz98mLqVupumo0rYWaL5lDWnYqtiVxfSg==',key_name='tempest-keypair-1143520029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-o05zd9bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=dadb69ec-5163-4e65-9656-3b80ee51fdf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.objects.instance [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'pci_devices' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:01:18 user nova-compute[73476]:   <uuid>dadb69ec-5163-4e65-9656-3b80ee51fdf0</uuid>
Aug 26 21:01:18 user nova-compute[73476]:   <name>instance-00000025</name>
Aug 26 21:01:18 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:01:18 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:01:18 user nova-compute[73476]:   <metadata>
Aug 26 21:01:18 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:01:18 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:01:18 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-891897880</nova:name>
Aug 26 21:01:18 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:01:17</nova:creationTime>
Aug 26 21:01:18 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:01:18 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:01:18 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:01:18 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:01:18 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:01:18 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:01:18 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:01:18 user nova-compute[73476]:       <nova:owner>
Aug 26 21:01:18 user nova-compute[73476]:         <nova:user uuid="23d582475c914098b5c6dce6268c2e2c">tempest-AttachVolumeShelveTestJSON-825342285-project-member</nova:user>
Aug 26 21:01:18 user nova-compute[73476]:         <nova:project uuid="69fdd3e8e61d47bd8a50affae1854448">tempest-AttachVolumeShelveTestJSON-825342285</nova:project>
Aug 26 21:01:18 user nova-compute[73476]:       </nova:owner>
Aug 26 21:01:18 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:01:18 user nova-compute[73476]:       <nova:ports>
Aug 26 21:01:18 user nova-compute[73476]:         <nova:port uuid="525b5d65-8ad1-445d-aa94-091fe68cbc0f">
Aug 26 21:01:18 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 21:01:18 user nova-compute[73476]:         </nova:port>
Aug 26 21:01:18 user nova-compute[73476]:       </nova:ports>
Aug 26 21:01:18 user nova-compute[73476]:     </nova:instance>
Aug 26 21:01:18 user nova-compute[73476]:   </metadata>
Aug 26 21:01:18 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:01:18 user nova-compute[73476]:     <system>
Aug 26 21:01:18 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:01:18 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:01:18 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:01:18 user nova-compute[73476]:       <entry name="serial">dadb69ec-5163-4e65-9656-3b80ee51fdf0</entry>
Aug 26 21:01:18 user nova-compute[73476]:       <entry name="uuid">dadb69ec-5163-4e65-9656-3b80ee51fdf0</entry>
Aug 26 21:01:18 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:01:18 user nova-compute[73476]:     </system>
Aug 26 21:01:18 user nova-compute[73476]:   </sysinfo>
Aug 26 21:01:18 user nova-compute[73476]:   <os>
Aug 26 21:01:18 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:01:18 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:01:18 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:01:18 user nova-compute[73476]:   </os>
Aug 26 21:01:18 user nova-compute[73476]:   <features>
Aug 26 21:01:18 user nova-compute[73476]:     <acpi/>
Aug 26 21:01:18 user nova-compute[73476]:     <apic/>
Aug 26 21:01:18 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:01:18 user nova-compute[73476]:   </features>
Aug 26 21:01:18 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:01:18 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:01:18 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:01:18 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:01:18 user nova-compute[73476]:   </clock>
Aug 26 21:01:18 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:01:18 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:01:18 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:01:18 user nova-compute[73476]:   </cpu>
Aug 26 21:01:18 user nova-compute[73476]:   <devices>
Aug 26 21:01:18 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:01:18 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:01:18 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk"/>
Aug 26 21:01:18 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:01:18 user nova-compute[73476]:     </disk>
Aug 26 21:01:18 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:01:18 user nova-compute[73476]:       <mac address="fa:16:3e:7e:b1:ed"/>
Aug 26 21:01:18 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:01:18 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:01:18 user nova-compute[73476]:       <target dev="tap525b5d65-8a"/>
Aug 26 21:01:18 user nova-compute[73476]:     </interface>
Aug 26 21:01:18 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:01:18 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/console.log" append="off"/>
Aug 26 21:01:18 user nova-compute[73476]:     </serial>
Aug 26 21:01:18 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:01:18 user nova-compute[73476]:     <video>
Aug 26 21:01:18 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:01:18 user nova-compute[73476]:     </video>
Aug 26 21:01:18 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:01:18 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:01:18 user nova-compute[73476]:     </rng>
Aug 26 21:01:18 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:01:18 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:01:18 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:01:18 user nova-compute[73476]:     </memballoon>
Aug 26 21:01:18 user nova-compute[73476]:   </devices>
Aug 26 21:01:18 user nova-compute[73476]: </domain>
Aug 26 21:01:18 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-891897880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-891897880',id=37,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkKX5RWHWnNaFPRwccSTJZClKfJCvxst9NrrwQIMgyEW01AEls4K3rtrSmyQitd/fHtBfBqYkZ8HNxZQAuEcfvKwbMHrWqgyAz98mLqVupumo0rYWaL5lDWnYqtiVxfSg==',key_name='tempest-keypair-1143520029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-o05zd9bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=dadb69ec-5163-4e65-9656-3b80ee51fdf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG os_vif [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525b5d65-8a, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap525b5d65-8a, col_values=(('external_ids', {'iface-id': '525b5d65-8ad1-445d-aa94-091fe68cbc0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b1:ed', 'vm-uuid': 'dadb69ec-5163-4e65-9656-3b80ee51fdf0'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:18 user nova-compute[73476]: INFO os_vif [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a')
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] No VIF found with MAC fa:16:3e:7e:b1:ed, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.network.neutron [req-d59b7381-d861-411c-8eea-475be9642098 req-d8ee5c70-321c-4ec1-ba5b-61963dd094c6 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updated VIF entry in instance network info cache for port 525b5d65-8ad1-445d-aa94-091fe68cbc0f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG nova.network.neutron [req-d59b7381-d861-411c-8eea-475be9642098 req-d8ee5c70-321c-4ec1-ba5b-61963dd094c6 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating instance_info_cache with network_info: [{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d59b7381-d861-411c-8eea-475be9642098 req-d8ee5c70-321c-4ec1-ba5b-61963dd094c6 service nova] Releasing lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:01:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-bf631641-5c62-423f-9189-0ffe2ada9df1 req-241aac72-bcb4-4c95-83fe-eed5c24c710e service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bf631641-5c62-423f-9189-0ffe2ada9df1 req-241aac72-bcb4-4c95-83fe-eed5c24c710e service nova] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bf631641-5c62-423f-9189-0ffe2ada9df1 req-241aac72-bcb4-4c95-83fe-eed5c24c710e service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bf631641-5c62-423f-9189-0ffe2ada9df1 req-241aac72-bcb4-4c95-83fe-eed5c24c710e service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-bf631641-5c62-423f-9189-0ffe2ada9df1 req-241aac72-bcb4-4c95-83fe-eed5c24c710e service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] No waiting events found dispatching network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:19 user nova-compute[73476]: WARNING nova.compute.manager [req-bf631641-5c62-423f-9189-0ffe2ada9df1 req-241aac72-bcb4-4c95-83fe-eed5c24c710e service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received unexpected event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f for instance with vm_state building and task_state spawning.
Aug 26 21:01:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083666.3466086, 22b50300-8865-4854-b0c7-ed63ca60c85b => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:01:21 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] VM Stopped (Lifecycle Event)
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7cb80572-fb07-4439-b891-26f1d404d2e8 None None] [instance: 22b50300-8865-4854-b0c7-ed63ca60c85b] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083681.7096016, dadb69ec-5163-4e65-9656-3b80ee51fdf0 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:01:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] VM Resumed (Lifecycle Event)
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:01:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance spawned successfully.
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:01:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083681.7136343, dadb69ec-5163-4e65-9656-3b80ee51fdf0 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:01:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] VM Started (Lifecycle Event)
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:01:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:01:21 user nova-compute[73476]: INFO nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-121e08c8-3190-49b7-9def-78f6baedbd2a req-47ec874b-e85d-4863-86c5-4eacdb383145 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-121e08c8-3190-49b7-9def-78f6baedbd2a req-47ec874b-e85d-4863-86c5-4eacdb383145 service nova] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-121e08c8-3190-49b7-9def-78f6baedbd2a req-47ec874b-e85d-4863-86c5-4eacdb383145 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-121e08c8-3190-49b7-9def-78f6baedbd2a req-47ec874b-e85d-4863-86c5-4eacdb383145 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-121e08c8-3190-49b7-9def-78f6baedbd2a req-47ec874b-e85d-4863-86c5-4eacdb383145 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] No waiting events found dispatching network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:21 user nova-compute[73476]: WARNING nova.compute.manager [req-121e08c8-3190-49b7-9def-78f6baedbd2a req-47ec874b-e85d-4863-86c5-4eacdb383145 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received unexpected event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f for instance with vm_state building and task_state spawning.
Aug 26 21:01:21 user nova-compute[73476]: INFO nova.compute.manager [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Took 7.12 seconds to build instance.
Aug 26 21:01:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-0b905e4d-9dc5-4edb-a1d8-b9d42599b4f6 tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.218s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:36 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:01:37 user nova-compute[73476]: INFO nova.compute.claims [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Claim successful on node user
Aug 26 21:01:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:01:37 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:01:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:01:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG nova.policy [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d2ff94872bd43dd8f7e4319e9e63934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed24e21a3624f4e8a4311728ff1c9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:01:38 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Creating image(s)
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "/opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "/opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.196s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk 1073741824" returned: 0 in 0.053s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Successfully created port: 64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Cannot resize image /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Ensure instance console log exists: /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Successfully updated port: 64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:01:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:01:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquired lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:01:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:01:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-09e46fa7-7506-46ff-8869-af5933e90aea req-08589355-ca9e-4dd4-a0e8-200c23a78031 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-changed-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-09e46fa7-7506-46ff-8869-af5933e90aea req-08589355-ca9e-4dd4-a0e8-200c23a78031 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Refreshing instance network info cache due to event network-changed-64288b3e-9d2a-4c14-9a96-308182a1bf4b. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:01:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-09e46fa7-7506-46ff-8869-af5933e90aea req-08589355-ca9e-4dd4-a0e8-200c23a78031 service nova] Acquiring lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating instance_info_cache with network_info: [{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Releasing lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance network_info: |[{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-09e46fa7-7506-46ff-8869-af5933e90aea req-08589355-ca9e-4dd4-a0e8-200c23a78031 service nova] Acquired lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.network.neutron [req-09e46fa7-7506-46ff-8869-af5933e90aea req-08589355-ca9e-4dd4-a0e8-200c23a78031 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Refreshing network info cache for port 64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Start _get_guest_xml network_info=[{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:01:40 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:40 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-688110644',display_name='tempest-AttachVolumeTestJSON-server-688110644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-688110644',id=38,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9LlIp4XneY32xtVLh6cIt5TSoHUqkcuD1XQ4hBSRMkm9So7JHOZP6BIojHT3q3aZ2oMpkm94dx8SqLtMc8f3ohUAvHCObRUe+gUe4wm/9E3dxtRL6BXFbzsvtqoJlbAw==',key_name='tempest-keypair-1294012772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-uhly31gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=7d07fece-58a4-46ec-902c-f1506956d1fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:01:40 user nova-compute[73476]:   <uuid>7d07fece-58a4-46ec-902c-f1506956d1fa</uuid>
Aug 26 21:01:40 user nova-compute[73476]:   <name>instance-00000026</name>
Aug 26 21:01:40 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:01:40 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:01:40 user nova-compute[73476]:   <metadata>
Aug 26 21:01:40 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:01:40 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:01:40 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeTestJSON-server-688110644</nova:name>
Aug 26 21:01:40 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:01:40</nova:creationTime>
Aug 26 21:01:40 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:01:40 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:01:40 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:01:40 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:01:40 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:01:40 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:01:40 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:01:40 user nova-compute[73476]:       <nova:owner>
Aug 26 21:01:40 user nova-compute[73476]:         <nova:user uuid="4d2ff94872bd43dd8f7e4319e9e63934">tempest-AttachVolumeTestJSON-359578438-project-member</nova:user>
Aug 26 21:01:40 user nova-compute[73476]:         <nova:project uuid="3ed24e21a3624f4e8a4311728ff1c9f5">tempest-AttachVolumeTestJSON-359578438</nova:project>
Aug 26 21:01:40 user nova-compute[73476]:       </nova:owner>
Aug 26 21:01:40 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:01:40 user nova-compute[73476]:       <nova:ports>
Aug 26 21:01:40 user nova-compute[73476]:         <nova:port uuid="64288b3e-9d2a-4c14-9a96-308182a1bf4b">
Aug 26 21:01:40 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 21:01:40 user nova-compute[73476]:         </nova:port>
Aug 26 21:01:40 user nova-compute[73476]:       </nova:ports>
Aug 26 21:01:40 user nova-compute[73476]:     </nova:instance>
Aug 26 21:01:40 user nova-compute[73476]:   </metadata>
Aug 26 21:01:40 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:01:40 user nova-compute[73476]:     <system>
Aug 26 21:01:40 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:01:40 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:01:40 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:01:40 user nova-compute[73476]:       <entry name="serial">7d07fece-58a4-46ec-902c-f1506956d1fa</entry>
Aug 26 21:01:40 user nova-compute[73476]:       <entry name="uuid">7d07fece-58a4-46ec-902c-f1506956d1fa</entry>
Aug 26 21:01:40 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:01:40 user nova-compute[73476]:     </system>
Aug 26 21:01:40 user nova-compute[73476]:   </sysinfo>
Aug 26 21:01:40 user nova-compute[73476]:   <os>
Aug 26 21:01:40 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:01:40 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:01:40 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:01:40 user nova-compute[73476]:   </os>
Aug 26 21:01:40 user nova-compute[73476]:   <features>
Aug 26 21:01:40 user nova-compute[73476]:     <acpi/>
Aug 26 21:01:40 user nova-compute[73476]:     <apic/>
Aug 26 21:01:40 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:01:40 user nova-compute[73476]:   </features>
Aug 26 21:01:40 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:01:40 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:01:40 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:01:40 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:01:40 user nova-compute[73476]:   </clock>
Aug 26 21:01:40 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:01:40 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:01:40 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:01:40 user nova-compute[73476]:   </cpu>
Aug 26 21:01:40 user nova-compute[73476]:   <devices>
Aug 26 21:01:40 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:01:40 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:01:40 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk"/>
Aug 26 21:01:40 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:01:40 user nova-compute[73476]:     </disk>
Aug 26 21:01:40 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:01:40 user nova-compute[73476]:       <mac address="fa:16:3e:40:fb:89"/>
Aug 26 21:01:40 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:01:40 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:01:40 user nova-compute[73476]:       <target dev="tap64288b3e-9d"/>
Aug 26 21:01:40 user nova-compute[73476]:     </interface>
Aug 26 21:01:40 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:01:40 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/console.log" append="off"/>
Aug 26 21:01:40 user nova-compute[73476]:     </serial>
Aug 26 21:01:40 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:01:40 user nova-compute[73476]:     <video>
Aug 26 21:01:40 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:01:40 user nova-compute[73476]:     </video>
Aug 26 21:01:40 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:01:40 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:01:40 user nova-compute[73476]:     </rng>
Aug 26 21:01:40 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:01:40 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:01:40 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:01:40 user nova-compute[73476]:     </memballoon>
Aug 26 21:01:40 user nova-compute[73476]:   </devices>
Aug 26 21:01:40 user nova-compute[73476]: </domain>
Aug 26 21:01:40 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-688110644',display_name='tempest-AttachVolumeTestJSON-server-688110644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-688110644',id=38,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9LlIp4XneY32xtVLh6cIt5TSoHUqkcuD1XQ4hBSRMkm9So7JHOZP6BIojHT3q3aZ2oMpkm94dx8SqLtMc8f3ohUAvHCObRUe+gUe4wm/9E3dxtRL6BXFbzsvtqoJlbAw==',key_name='tempest-keypair-1294012772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-uhly31gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=7d07fece-58a4-46ec-902c-f1506956d1fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG os_vif [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64288b3e-9d, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64288b3e-9d, col_values=(('external_ids', {'iface-id': '64288b3e-9d2a-4c14-9a96-308182a1bf4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:fb:89', 'vm-uuid': '7d07fece-58a4-46ec-902c-f1506956d1fa'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:40 user nova-compute[73476]: INFO os_vif [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d')
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:01:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No VIF found with MAC fa:16:3e:40:fb:89, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:01:41 user nova-compute[73476]: DEBUG nova.network.neutron [req-09e46fa7-7506-46ff-8869-af5933e90aea req-08589355-ca9e-4dd4-a0e8-200c23a78031 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updated VIF entry in instance network info cache for port 64288b3e-9d2a-4c14-9a96-308182a1bf4b. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:01:41 user nova-compute[73476]: DEBUG nova.network.neutron [req-09e46fa7-7506-46ff-8869-af5933e90aea req-08589355-ca9e-4dd4-a0e8-200c23a78031 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating instance_info_cache with network_info: [{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-09e46fa7-7506-46ff-8869-af5933e90aea req-08589355-ca9e-4dd4-a0e8-200c23a78031 service nova] Releasing lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:01:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:41 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:01:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:41 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:01:41 user nova-compute[73476]: INFO nova.compute.claims [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Claim successful on node user
Aug 26 21:01:42 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:01:42 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:01:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG nova.policy [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7600fe3f150b40b8a9905a7590aa2bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273b5f4f187d4443b5b2e563133b60b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:01:42 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Creating image(s)
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "/opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "/opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "/opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.233s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.207s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk 1073741824" returned: 0 in 0.059s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Cannot resize image /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Ensure instance console log exists: /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:43 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Successfully created port: 62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083704.8091955, 7d07fece-58a4-46ec-902c-f1506956d1fa => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:01:44 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] VM Resumed (Lifecycle Event)
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:01:44 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance spawned successfully.
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:44 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083704.8108406, 7d07fece-58a4-46ec-902c-f1506956d1fa => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:01:44 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] VM Started (Lifecycle Event)
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:01:44 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:01:44 user nova-compute[73476]: INFO nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Took 6.94 seconds to spawn the instance on the hypervisor.
Aug 26 21:01:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Successfully updated port: 62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquired lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9f80efd3-ffba-4d3f-8ff5-6ed1eeefb6fb req-bb0048cc-3bec-4db8-93af-3ba65568ecb0 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received event network-changed-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9f80efd3-ffba-4d3f-8ff5-6ed1eeefb6fb req-bb0048cc-3bec-4db8-93af-3ba65568ecb0 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Refreshing instance network info cache due to event network-changed-62f3add4-5ee8-4a2c-befd-9848fbc2ad46. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9f80efd3-ffba-4d3f-8ff5-6ed1eeefb6fb req-bb0048cc-3bec-4db8-93af-3ba65568ecb0 service nova] Acquiring lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:01:45 user nova-compute[73476]: INFO nova.compute.manager [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Took 7.69 seconds to build instance.
Aug 26 21:01:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cb3581eb-d70e-41e5-b77e-3de99f97d0f5 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.801s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updating instance_info_cache with network_info: [{"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Releasing lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Instance network_info: |[{"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9f80efd3-ffba-4d3f-8ff5-6ed1eeefb6fb req-bb0048cc-3bec-4db8-93af-3ba65568ecb0 service nova] Acquired lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.network.neutron [req-9f80efd3-ffba-4d3f-8ff5-6ed1eeefb6fb req-bb0048cc-3bec-4db8-93af-3ba65568ecb0 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Refreshing network info cache for port 62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Start _get_guest_xml network_info=[{"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:01:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:45 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-553883470',display_name='tempest-TestStampPattern-server-553883470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-553883470',id=39,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBJxN4wvMn8Jar6NrIBiYVMiu3vgfLkl6323Mn8p765asBJjOSbk1YLZEFjYoYJLW4VOzDi5yHEmiOk8JKFOVGKLi4tNN1pZeSYxVVQ4b/Q10+a3fyslhJc+nWG56XtGA==',key_name='tempest-TestStampPattern-1984164735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='273b5f4f187d4443b5b2e563133b60b4',ramdisk_id='',reservation_id='r-cj60b1t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1638669422',owner_user_name='tempest-TestStampPattern-1638669422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:01:42Z,user_data=None,user_id='7600fe3f150b40b8a9905a7590aa2bf2',uuid=3639bd9f-308c-4680-b18c-0720d6f18327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converting VIF {"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:fa:70,bridge_name='br-int',has_traffic_filtering=True,id=62f3add4-5ee8-4a2c-befd-9848fbc2ad46,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f3add4-5e') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'pci_devices' on Instance uuid 3639bd9f-308c-4680-b18c-0720d6f18327 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:01:45 user nova-compute[73476]:   <uuid>3639bd9f-308c-4680-b18c-0720d6f18327</uuid>
Aug 26 21:01:45 user nova-compute[73476]:   <name>instance-00000027</name>
Aug 26 21:01:45 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:01:45 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:01:45 user nova-compute[73476]:   <metadata>
Aug 26 21:01:45 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:01:45 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:01:45 user nova-compute[73476]:       <nova:name>tempest-TestStampPattern-server-553883470</nova:name>
Aug 26 21:01:45 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:01:45</nova:creationTime>
Aug 26 21:01:45 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:01:45 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:01:45 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:01:45 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:01:45 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:01:45 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:01:45 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:01:45 user nova-compute[73476]:       <nova:owner>
Aug 26 21:01:45 user nova-compute[73476]:         <nova:user uuid="7600fe3f150b40b8a9905a7590aa2bf2">tempest-TestStampPattern-1638669422-project-member</nova:user>
Aug 26 21:01:45 user nova-compute[73476]:         <nova:project uuid="273b5f4f187d4443b5b2e563133b60b4">tempest-TestStampPattern-1638669422</nova:project>
Aug 26 21:01:45 user nova-compute[73476]:       </nova:owner>
Aug 26 21:01:45 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:01:45 user nova-compute[73476]:       <nova:ports>
Aug 26 21:01:45 user nova-compute[73476]:         <nova:port uuid="62f3add4-5ee8-4a2c-befd-9848fbc2ad46">
Aug 26 21:01:45 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 21:01:45 user nova-compute[73476]:         </nova:port>
Aug 26 21:01:45 user nova-compute[73476]:       </nova:ports>
Aug 26 21:01:45 user nova-compute[73476]:     </nova:instance>
Aug 26 21:01:45 user nova-compute[73476]:   </metadata>
Aug 26 21:01:45 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:01:45 user nova-compute[73476]:     <system>
Aug 26 21:01:45 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:01:45 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:01:45 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:01:45 user nova-compute[73476]:       <entry name="serial">3639bd9f-308c-4680-b18c-0720d6f18327</entry>
Aug 26 21:01:45 user nova-compute[73476]:       <entry name="uuid">3639bd9f-308c-4680-b18c-0720d6f18327</entry>
Aug 26 21:01:45 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:01:45 user nova-compute[73476]:     </system>
Aug 26 21:01:45 user nova-compute[73476]:   </sysinfo>
Aug 26 21:01:45 user nova-compute[73476]:   <os>
Aug 26 21:01:45 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:01:45 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:01:45 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:01:45 user nova-compute[73476]:   </os>
Aug 26 21:01:45 user nova-compute[73476]:   <features>
Aug 26 21:01:45 user nova-compute[73476]:     <acpi/>
Aug 26 21:01:45 user nova-compute[73476]:     <apic/>
Aug 26 21:01:45 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:01:45 user nova-compute[73476]:   </features>
Aug 26 21:01:45 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:01:45 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:01:45 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:01:45 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:01:45 user nova-compute[73476]:   </clock>
Aug 26 21:01:45 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:01:45 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:01:45 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:01:45 user nova-compute[73476]:   </cpu>
Aug 26 21:01:45 user nova-compute[73476]:   <devices>
Aug 26 21:01:45 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:01:45 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:01:45 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk"/>
Aug 26 21:01:45 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:01:45 user nova-compute[73476]:     </disk>
Aug 26 21:01:45 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:01:45 user nova-compute[73476]:       <mac address="fa:16:3e:47:fa:70"/>
Aug 26 21:01:45 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:01:45 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:01:45 user nova-compute[73476]:       <target dev="tap62f3add4-5e"/>
Aug 26 21:01:45 user nova-compute[73476]:     </interface>
Aug 26 21:01:45 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:01:45 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/console.log" append="off"/>
Aug 26 21:01:45 user nova-compute[73476]:     </serial>
Aug 26 21:01:45 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:01:45 user nova-compute[73476]:     <video>
Aug 26 21:01:45 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:01:45 user nova-compute[73476]:     </video>
Aug 26 21:01:45 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:01:45 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:01:45 user nova-compute[73476]:     </rng>
Aug 26 21:01:45 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:01:45 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:01:45 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:01:45 user nova-compute[73476]:     </memballoon>
Aug 26 21:01:45 user nova-compute[73476]:   </devices>
Aug 26 21:01:45 user nova-compute[73476]: </domain>
Aug 26 21:01:45 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-553883470',display_name='tempest-TestStampPattern-server-553883470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-553883470',id=39,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBJxN4wvMn8Jar6NrIBiYVMiu3vgfLkl6323Mn8p765asBJjOSbk1YLZEFjYoYJLW4VOzDi5yHEmiOk8JKFOVGKLi4tNN1pZeSYxVVQ4b/Q10+a3fyslhJc+nWG56XtGA==',key_name='tempest-TestStampPattern-1984164735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='273b5f4f187d4443b5b2e563133b60b4',ramdisk_id='',reservation_id='r-cj60b1t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1638669422',owner_user_name='tempest-TestStampPattern-1638669422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:01:42Z,user_data=None,user_id='7600fe3f150b40b8a9905a7590aa2bf2',uuid=3639bd9f-308c-4680-b18c-0720d6f18327,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converting VIF {"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:fa:70,bridge_name='br-int',has_traffic_filtering=True,id=62f3add4-5ee8-4a2c-befd-9848fbc2ad46,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f3add4-5e') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG os_vif [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:fa:70,bridge_name='br-int',has_traffic_filtering=True,id=62f3add4-5ee8-4a2c-befd-9848fbc2ad46,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f3add4-5e') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62f3add4-5e, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62f3add4-5e, col_values=(('external_ids', {'iface-id': '62f3add4-5ee8-4a2c-befd-9848fbc2ad46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:fa:70', 'vm-uuid': '3639bd9f-308c-4680-b18c-0720d6f18327'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:45 user nova-compute[73476]: INFO os_vif [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:fa:70,bridge_name='br-int',has_traffic_filtering=True,id=62f3add4-5ee8-4a2c-befd-9848fbc2ad46,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f3add4-5e')
Aug 26 21:01:45 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:01:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No VIF found with MAC fa:16:3e:47:fa:70, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-9f80efd3-ffba-4d3f-8ff5-6ed1eeefb6fb req-bb0048cc-3bec-4db8-93af-3ba65568ecb0 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updated VIF entry in instance network info cache for port 62f3add4-5ee8-4a2c-befd-9848fbc2ad46. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-9f80efd3-ffba-4d3f-8ff5-6ed1eeefb6fb req-bb0048cc-3bec-4db8-93af-3ba65568ecb0 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updating instance_info_cache with network_info: [{"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9f80efd3-ffba-4d3f-8ff5-6ed1eeefb6fb req-bb0048cc-3bec-4db8-93af-3ba65568ecb0 service nova] Releasing lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "5fd9668d-011b-429c-8021-c0296dbeee0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:01:46 user nova-compute[73476]: INFO nova.compute.claims [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Claim successful on node user
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:01:46 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:01:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.policy [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6561f885aedc4f3babc29d0d887cebf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8898a711cbc44ce3927e58efdcc04106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:01:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Creating image(s)
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "/opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "/opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:47 user nova-compute[73476]: WARNING nova.compute.manager [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state active and task_state None.
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:47 user nova-compute[73476]: WARNING nova.compute.manager [req-e747c93c-e82c-446a-aae2-da4a43911011 req-a9ad8b10-bc8d-4358-957c-52b5b35a30e5 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state active and task_state None.
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.273s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk 1073741824" returned: 0 in 0.074s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Skipping network cache update for instance because it is Building. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Skipping network cache update for instance because it is Building. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.207s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:01:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Cannot resize image /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Ensure instance console log exists: /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Successfully created port: fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updating instance_info_cache with network_info: [{"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:01:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received event network-vif-plugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] No waiting events found dispatching network-vif-plugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:49 user nova-compute[73476]: WARNING nova.compute.manager [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received unexpected event network-vif-plugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 for instance with vm_state building and task_state spawning.
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received event network-vif-plugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] No waiting events found dispatching network-vif-plugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:49 user nova-compute[73476]: WARNING nova.compute.manager [req-066ff749-c3b2-4396-baa5-648bdca1c807 req-e35c6c5e-78b3-43e4-bcfc-02585af551ed service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received unexpected event network-vif-plugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 for instance with vm_state building and task_state spawning.
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083709.364158, 3639bd9f-308c-4680-b18c-0720d6f18327 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:01:49 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] VM Resumed (Lifecycle Event)
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:01:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Instance spawned successfully.
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:49 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083709.3655245, 3639bd9f-308c-4680-b18c-0720d6f18327 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:01:49 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] VM Started (Lifecycle Event)
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.network.neutron [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Successfully updated port: fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:01:49 user nova-compute[73476]: INFO nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:49 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "refresh_cache-5fd9668d-011b-429c-8021-c0296dbeee0a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquired lock "refresh_cache-5fd9668d-011b-429c-8021-c0296dbeee0a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.network.neutron [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.network.neutron [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:01:49 user nova-compute[73476]: INFO nova.compute.manager [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Took 7.82 seconds to build instance.
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f51144cc-ab6d-45f5-a8ec-cd71f9c3b340 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.939s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.network.neutron [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Updating instance_info_cache with network_info: [{"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Releasing lock "refresh_cache-5fd9668d-011b-429c-8021-c0296dbeee0a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Instance network_info: |[{"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Start _get_guest_xml network_info=[{"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:01:49 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:49 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-676941162',display_name='tempest-ServersNegativeTestJSON-server-676941162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-676941162',id=40,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8898a711cbc44ce3927e58efdcc04106',ramdisk_id='',reservation_id='r-370sq6dn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-969438150',owner_user_name='tempest-ServersNegativeTestJSON-969438150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:01:47Z,user_data=None,user_id='6561f885aedc4f3babc29d0d887cebf6',uuid=5fd9668d-011b-429c-8021-c0296dbeee0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converting VIF {"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7f:d4,bridge_name='br-int',has_traffic_filtering=True,id=fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5a7d7a-91') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.objects.instance [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fd9668d-011b-429c-8021-c0296dbeee0a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:01:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:01:49 user nova-compute[73476]:   <uuid>5fd9668d-011b-429c-8021-c0296dbeee0a</uuid>
Aug 26 21:01:49 user nova-compute[73476]:   <name>instance-00000028</name>
Aug 26 21:01:49 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:01:49 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:01:49 user nova-compute[73476]:   <metadata>
Aug 26 21:01:49 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:01:49 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:01:49 user nova-compute[73476]:       <nova:name>tempest-ServersNegativeTestJSON-server-676941162</nova:name>
Aug 26 21:01:49 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:01:49</nova:creationTime>
Aug 26 21:01:49 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:01:49 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:01:49 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:01:49 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:01:49 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:01:49 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:01:49 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:01:49 user nova-compute[73476]:       <nova:owner>
Aug 26 21:01:49 user nova-compute[73476]:         <nova:user uuid="6561f885aedc4f3babc29d0d887cebf6">tempest-ServersNegativeTestJSON-969438150-project-member</nova:user>
Aug 26 21:01:49 user nova-compute[73476]:         <nova:project uuid="8898a711cbc44ce3927e58efdcc04106">tempest-ServersNegativeTestJSON-969438150</nova:project>
Aug 26 21:01:49 user nova-compute[73476]:       </nova:owner>
Aug 26 21:01:49 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:01:49 user nova-compute[73476]:       <nova:ports>
Aug 26 21:01:49 user nova-compute[73476]:         <nova:port uuid="fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0">
Aug 26 21:01:49 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 21:01:49 user nova-compute[73476]:         </nova:port>
Aug 26 21:01:49 user nova-compute[73476]:       </nova:ports>
Aug 26 21:01:49 user nova-compute[73476]:     </nova:instance>
Aug 26 21:01:49 user nova-compute[73476]:   </metadata>
Aug 26 21:01:49 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:01:49 user nova-compute[73476]:     <system>
Aug 26 21:01:49 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:01:49 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:01:49 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:01:49 user nova-compute[73476]:       <entry name="serial">5fd9668d-011b-429c-8021-c0296dbeee0a</entry>
Aug 26 21:01:49 user nova-compute[73476]:       <entry name="uuid">5fd9668d-011b-429c-8021-c0296dbeee0a</entry>
Aug 26 21:01:49 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:01:49 user nova-compute[73476]:     </system>
Aug 26 21:01:49 user nova-compute[73476]:   </sysinfo>
Aug 26 21:01:49 user nova-compute[73476]:   <os>
Aug 26 21:01:49 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:01:49 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:01:49 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:01:49 user nova-compute[73476]:   </os>
Aug 26 21:01:49 user nova-compute[73476]:   <features>
Aug 26 21:01:49 user nova-compute[73476]:     <acpi/>
Aug 26 21:01:49 user nova-compute[73476]:     <apic/>
Aug 26 21:01:49 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:01:49 user nova-compute[73476]:   </features>
Aug 26 21:01:49 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:01:49 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:01:49 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:01:49 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:01:49 user nova-compute[73476]:   </clock>
Aug 26 21:01:49 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:01:49 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:01:49 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:01:49 user nova-compute[73476]:   </cpu>
Aug 26 21:01:49 user nova-compute[73476]:   <devices>
Aug 26 21:01:49 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:01:49 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:01:49 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk"/>
Aug 26 21:01:49 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:01:49 user nova-compute[73476]:     </disk>
Aug 26 21:01:49 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:01:49 user nova-compute[73476]:       <mac address="fa:16:3e:1f:7f:d4"/>
Aug 26 21:01:49 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:01:49 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:01:49 user nova-compute[73476]:       <target dev="tapfc5a7d7a-91"/>
Aug 26 21:01:49 user nova-compute[73476]:     </interface>
Aug 26 21:01:49 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:01:49 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/console.log" append="off"/>
Aug 26 21:01:49 user nova-compute[73476]:     </serial>
Aug 26 21:01:49 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:01:49 user nova-compute[73476]:     <video>
Aug 26 21:01:49 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:01:49 user nova-compute[73476]:     </video>
Aug 26 21:01:49 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:01:49 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:01:49 user nova-compute[73476]:     </rng>
Aug 26 21:01:49 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:01:49 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:01:49 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:01:49 user nova-compute[73476]:     </memballoon>
Aug 26 21:01:49 user nova-compute[73476]:   </devices>
Aug 26 21:01:49 user nova-compute[73476]: </domain>
Aug 26 21:01:49 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-676941162',display_name='tempest-ServersNegativeTestJSON-server-676941162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-676941162',id=40,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8898a711cbc44ce3927e58efdcc04106',ramdisk_id='',reservation_id='r-370sq6dn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-969438150',owner_user_name='tempest-ServersNegativeTestJSON-969438150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:01:47Z,user_data=None,user_id='6561f885aedc4f3babc29d0d887cebf6',uuid=5fd9668d-011b-429c-8021-c0296dbeee0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converting VIF {"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7f:d4,bridge_name='br-int',has_traffic_filtering=True,id=fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5a7d7a-91') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG os_vif [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7f:d4,bridge_name='br-int',has_traffic_filtering=True,id=fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5a7d7a-91') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc5a7d7a-91, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc5a7d7a-91, col_values=(('external_ids', {'iface-id': 'fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:7f:d4', 'vm-uuid': '5fd9668d-011b-429c-8021-c0296dbeee0a'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:50 user nova-compute[73476]: INFO os_vif [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7f:d4,bridge_name='br-int',has_traffic_filtering=True,id=fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5a7d7a-91')
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] No VIF found with MAC fa:16:3e:1f:7f:d4, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG nova.compute.manager [req-a6a7aa3e-2d8e-48b9-9de3-453f3c066770 req-ebd0fd7f-19a7-4d11-8ace-92b8f12ab031 service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received event network-changed-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG nova.compute.manager [req-a6a7aa3e-2d8e-48b9-9de3-453f3c066770 req-ebd0fd7f-19a7-4d11-8ace-92b8f12ab031 service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Refreshing instance network info cache due to event network-changed-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a6a7aa3e-2d8e-48b9-9de3-453f3c066770 req-ebd0fd7f-19a7-4d11-8ace-92b8f12ab031 service nova] Acquiring lock "refresh_cache-5fd9668d-011b-429c-8021-c0296dbeee0a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a6a7aa3e-2d8e-48b9-9de3-453f3c066770 req-ebd0fd7f-19a7-4d11-8ace-92b8f12ab031 service nova] Acquired lock "refresh_cache-5fd9668d-011b-429c-8021-c0296dbeee0a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-a6a7aa3e-2d8e-48b9-9de3-453f3c066770 req-ebd0fd7f-19a7-4d11-8ace-92b8f12ab031 service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Refreshing network info cache for port fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083713.7895916, 5fd9668d-011b-429c-8021-c0296dbeee0a => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:01:54 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] VM Resumed (Lifecycle Event)
Aug 26 21:01:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received event network-vif-plugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] Acquiring lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] No waiting events found dispatching network-vif-plugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:54 user nova-compute[73476]: WARNING nova.compute.manager [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received unexpected event network-vif-plugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 for instance with vm_state building and task_state spawning.
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received event network-vif-plugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] Acquiring lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] No waiting events found dispatching network-vif-plugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:01:54 user nova-compute[73476]: WARNING nova.compute.manager [req-f751db62-058a-4a0e-a15b-54027c151eea req-667d85bc-319a-4ca6-a474-4ca2818a6e2d service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received unexpected event network-vif-plugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 for instance with vm_state building and task_state spawning.
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:54 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:54 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8290MB free_disk=25.302104949951172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:01:54 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Instance spawned successfully.
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:01:54 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083713.7901728, 5fd9668d-011b-429c-8021-c0296dbeee0a => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:01:54 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] VM Started (Lifecycle Event)
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:01:54 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:01:54 user nova-compute[73476]: INFO nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Took 7.18 seconds to spawn the instance on the hypervisor.
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance dadb69ec-5163-4e65-9656-3b80ee51fdf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3639bd9f-308c-4680-b18c-0720d6f18327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 5fd9668d-011b-429c-8021-c0296dbeee0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-a6a7aa3e-2d8e-48b9-9de3-453f3c066770 req-ebd0fd7f-19a7-4d11-8ace-92b8f12ab031 service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Updated VIF entry in instance network info cache for port fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.network.neutron [req-a6a7aa3e-2d8e-48b9-9de3-453f3c066770 req-ebd0fd7f-19a7-4d11-8ace-92b8f12ab031 service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Updating instance_info_cache with network_info: [{"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a6a7aa3e-2d8e-48b9-9de3-453f3c066770 req-ebd0fd7f-19a7-4d11-8ace-92b8f12ab031 service nova] Releasing lock "refresh_cache-5fd9668d-011b-429c-8021-c0296dbeee0a" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:01:54 user nova-compute[73476]: INFO nova.compute.manager [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Took 7.86 seconds to build instance.
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3c4774b5-770f-410b-a7e4-9ac378890850 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.963s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:01:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:01:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:55 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:01:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:01:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:02:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:37 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:37 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:02:38 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73476) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 21:02:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:49 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:02:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:02:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:02:49 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating instance_info_cache with network_info: [{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:02:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:02:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8083MB free_disk=25.206634521484375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance dadb69ec-5163-4e65-9656-3b80ee51fdf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3639bd9f-308c-4680-b18c-0720d6f18327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 5fd9668d-011b-429c-8021-c0296dbeee0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing inventories for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating ProviderTree inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing aggregate associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, aggregates: None {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing trait associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:02:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:02:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:02:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:02:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:02:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:02:55 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:02:55 user nova-compute[73476]: INFO nova.compute.claims [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Claim successful on node user
Aug 26 21:02:55 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:02:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.policy [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9fdaeb7bcc6482e87bb4b9757c5ff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b84b4dda8794d89a3b826169d3622ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:02:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Creating image(s)
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "/opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "/opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "/opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.175s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk 1073741824" returned: 0 in 0.061s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Successfully created port: c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:02:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Cannot resize image /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Ensure instance console log exists: /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Successfully updated port: c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "refresh_cache-b699d711-cfff-4095-a9fe-e6ad1bad94eb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquired lock "refresh_cache-b699d711-cfff-4095-a9fe-e6ad1bad94eb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:02:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-7aac5a9c-b4a0-41e5-ada0-dab17973f841 req-43f2343c-f96f-4276-bddc-10eb41ea9b47 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received event network-changed-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-7aac5a9c-b4a0-41e5-ada0-dab17973f841 req-43f2343c-f96f-4276-bddc-10eb41ea9b47 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Refreshing instance network info cache due to event network-changed-c3b18763-d863-4a04-879e-1de60aa7e6a0. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7aac5a9c-b4a0-41e5-ada0-dab17973f841 req-43f2343c-f96f-4276-bddc-10eb41ea9b47 service nova] Acquiring lock "refresh_cache-b699d711-cfff-4095-a9fe-e6ad1bad94eb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Updating instance_info_cache with network_info: [{"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Releasing lock "refresh_cache-b699d711-cfff-4095-a9fe-e6ad1bad94eb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Instance network_info: |[{"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7aac5a9c-b4a0-41e5-ada0-dab17973f841 req-43f2343c-f96f-4276-bddc-10eb41ea9b47 service nova] Acquired lock "refresh_cache-b699d711-cfff-4095-a9fe-e6ad1bad94eb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.network.neutron [req-7aac5a9c-b4a0-41e5-ada0-dab17973f841 req-43f2343c-f96f-4276-bddc-10eb41ea9b47 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Refreshing network info cache for port c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Start _get_guest_xml network_info=[{"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:02:58 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:02:58 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1692837612',display_name='tempest-VolumesSnapshotTestJSON-instance-1692837612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1692837612',id=41,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1O1pcUSRPBrB9k8V8jFhm3EEqHgZCVqbJqbJDVJ3A7pTRO+M2AYwKU24pu8tv6Ww3meaKnOkAoi6Y/h+n84OpG50mjYdXDPmpVD/BFhCfuSocFwafv0uY0AxJvvqWVaA==',key_name='tempest-keypair-978889703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b84b4dda8794d89a3b826169d3622ae',ramdisk_id='',reservation_id='r-192ipznn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1103521950',owner_user_name='tempest-VolumesSnapshotTestJSON-1103521950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9fdaeb7bcc6482e87bb4b9757c5ff94',uuid=b699d711-cfff-4095-a9fe-e6ad1bad94eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converting VIF {"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3b18763-d863-4a04-879e-1de60aa7e6a0,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b18763-d8') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.objects.instance [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'pci_devices' on Instance uuid b699d711-cfff-4095-a9fe-e6ad1bad94eb {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:02:58 user nova-compute[73476]:   <uuid>b699d711-cfff-4095-a9fe-e6ad1bad94eb</uuid>
Aug 26 21:02:58 user nova-compute[73476]:   <name>instance-00000029</name>
Aug 26 21:02:58 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:02:58 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:02:58 user nova-compute[73476]:   <metadata>
Aug 26 21:02:58 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:02:58 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:02:58 user nova-compute[73476]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1692837612</nova:name>
Aug 26 21:02:58 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:02:58</nova:creationTime>
Aug 26 21:02:58 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:02:58 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:02:58 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:02:58 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:02:58 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:02:58 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:02:58 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:02:58 user nova-compute[73476]:       <nova:owner>
Aug 26 21:02:58 user nova-compute[73476]:         <nova:user uuid="a9fdaeb7bcc6482e87bb4b9757c5ff94">tempest-VolumesSnapshotTestJSON-1103521950-project-member</nova:user>
Aug 26 21:02:58 user nova-compute[73476]:         <nova:project uuid="8b84b4dda8794d89a3b826169d3622ae">tempest-VolumesSnapshotTestJSON-1103521950</nova:project>
Aug 26 21:02:58 user nova-compute[73476]:       </nova:owner>
Aug 26 21:02:58 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:02:58 user nova-compute[73476]:       <nova:ports>
Aug 26 21:02:58 user nova-compute[73476]:         <nova:port uuid="c3b18763-d863-4a04-879e-1de60aa7e6a0">
Aug 26 21:02:58 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 21:02:58 user nova-compute[73476]:         </nova:port>
Aug 26 21:02:58 user nova-compute[73476]:       </nova:ports>
Aug 26 21:02:58 user nova-compute[73476]:     </nova:instance>
Aug 26 21:02:58 user nova-compute[73476]:   </metadata>
Aug 26 21:02:58 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:02:58 user nova-compute[73476]:     <system>
Aug 26 21:02:58 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:02:58 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:02:58 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:02:58 user nova-compute[73476]:       <entry name="serial">b699d711-cfff-4095-a9fe-e6ad1bad94eb</entry>
Aug 26 21:02:58 user nova-compute[73476]:       <entry name="uuid">b699d711-cfff-4095-a9fe-e6ad1bad94eb</entry>
Aug 26 21:02:58 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:02:58 user nova-compute[73476]:     </system>
Aug 26 21:02:58 user nova-compute[73476]:   </sysinfo>
Aug 26 21:02:58 user nova-compute[73476]:   <os>
Aug 26 21:02:58 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:02:58 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:02:58 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:02:58 user nova-compute[73476]:   </os>
Aug 26 21:02:58 user nova-compute[73476]:   <features>
Aug 26 21:02:58 user nova-compute[73476]:     <acpi/>
Aug 26 21:02:58 user nova-compute[73476]:     <apic/>
Aug 26 21:02:58 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:02:58 user nova-compute[73476]:   </features>
Aug 26 21:02:58 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:02:58 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:02:58 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:02:58 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:02:58 user nova-compute[73476]:   </clock>
Aug 26 21:02:58 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:02:58 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:02:58 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:02:58 user nova-compute[73476]:   </cpu>
Aug 26 21:02:58 user nova-compute[73476]:   <devices>
Aug 26 21:02:58 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:02:58 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:02:58 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk"/>
Aug 26 21:02:58 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:02:58 user nova-compute[73476]:     </disk>
Aug 26 21:02:58 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:02:58 user nova-compute[73476]:       <mac address="fa:16:3e:2b:26:f2"/>
Aug 26 21:02:58 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:02:58 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:02:58 user nova-compute[73476]:       <target dev="tapc3b18763-d8"/>
Aug 26 21:02:58 user nova-compute[73476]:     </interface>
Aug 26 21:02:58 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:02:58 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/console.log" append="off"/>
Aug 26 21:02:58 user nova-compute[73476]:     </serial>
Aug 26 21:02:58 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:02:58 user nova-compute[73476]:     <video>
Aug 26 21:02:58 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:02:58 user nova-compute[73476]:     </video>
Aug 26 21:02:58 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:02:58 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:02:58 user nova-compute[73476]:     </rng>
Aug 26 21:02:58 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:02:58 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:02:58 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:02:58 user nova-compute[73476]:     </memballoon>
Aug 26 21:02:58 user nova-compute[73476]:   </devices>
Aug 26 21:02:58 user nova-compute[73476]: </domain>
Aug 26 21:02:58 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1692837612',display_name='tempest-VolumesSnapshotTestJSON-instance-1692837612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1692837612',id=41,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1O1pcUSRPBrB9k8V8jFhm3EEqHgZCVqbJqbJDVJ3A7pTRO+M2AYwKU24pu8tv6Ww3meaKnOkAoi6Y/h+n84OpG50mjYdXDPmpVD/BFhCfuSocFwafv0uY0AxJvvqWVaA==',key_name='tempest-keypair-978889703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b84b4dda8794d89a3b826169d3622ae',ramdisk_id='',reservation_id='r-192ipznn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1103521950',owner_user_name='tempest-VolumesSnapshotTestJSON-1103521950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9fdaeb7bcc6482e87bb4b9757c5ff94',uuid=b699d711-cfff-4095-a9fe-e6ad1bad94eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converting VIF {"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3b18763-d863-4a04-879e-1de60aa7e6a0,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b18763-d8') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG os_vif [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3b18763-d863-4a04-879e-1de60aa7e6a0,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b18763-d8') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3b18763-d8, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3b18763-d8, col_values=(('external_ids', {'iface-id': 'c3b18763-d863-4a04-879e-1de60aa7e6a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:26:f2', 'vm-uuid': 'b699d711-cfff-4095-a9fe-e6ad1bad94eb'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:58 user nova-compute[73476]: INFO os_vif [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3b18763-d863-4a04-879e-1de60aa7e6a0,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b18763-d8')
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No VIF found with MAC fa:16:3e:2b:26:f2, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.network.neutron [req-7aac5a9c-b4a0-41e5-ada0-dab17973f841 req-43f2343c-f96f-4276-bddc-10eb41ea9b47 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Updated VIF entry in instance network info cache for port c3b18763-d863-4a04-879e-1de60aa7e6a0. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG nova.network.neutron [req-7aac5a9c-b4a0-41e5-ada0-dab17973f841 req-43f2343c-f96f-4276-bddc-10eb41ea9b47 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Updating instance_info_cache with network_info: [{"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:02:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7aac5a9c-b4a0-41e5-ada0-dab17973f841 req-43f2343c-f96f-4276-bddc-10eb41ea9b47 service nova] Releasing lock "refresh_cache-b699d711-cfff-4095-a9fe-e6ad1bad94eb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:02:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:02:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-6af8c965-8656-4cdb-ab94-673c213ad76a req-c407d0b3-a6e1-4e63-bb43-82459927e7ed service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received event network-vif-plugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6af8c965-8656-4cdb-ab94-673c213ad76a req-c407d0b3-a6e1-4e63-bb43-82459927e7ed service nova] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6af8c965-8656-4cdb-ab94-673c213ad76a req-c407d0b3-a6e1-4e63-bb43-82459927e7ed service nova] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6af8c965-8656-4cdb-ab94-673c213ad76a req-c407d0b3-a6e1-4e63-bb43-82459927e7ed service nova] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-6af8c965-8656-4cdb-ab94-673c213ad76a req-c407d0b3-a6e1-4e63-bb43-82459927e7ed service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] No waiting events found dispatching network-vif-plugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:03:00 user nova-compute[73476]: WARNING nova.compute.manager [req-6af8c965-8656-4cdb-ab94-673c213ad76a req-c407d0b3-a6e1-4e63-bb43-82459927e7ed service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received unexpected event network-vif-plugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 for instance with vm_state building and task_state spawning.
Aug 26 21:03:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083781.9319513, b699d711-cfff-4095-a9fe-e6ad1bad94eb => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:03:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] VM Resumed (Lifecycle Event)
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:03:01 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Instance spawned successfully.
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:03:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:03:01 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083781.932142, b699d711-cfff-4095-a9fe-e6ad1bad94eb => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:03:01 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] VM Started (Lifecycle Event)
Aug 26 21:03:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:03:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:03:02 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:03:02 user nova-compute[73476]: INFO nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 26 21:03:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:03:02 user nova-compute[73476]: INFO nova.compute.manager [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Took 6.33 seconds to build instance.
Aug 26 21:03:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8a36adc7-1131-401b-98fb-c7fb651f3cfc tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.429s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-441de6f0-f2a9-490d-870c-341cbe4a08a9 req-9892430f-e699-456a-9fc8-b274b79cd423 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received event network-vif-plugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-441de6f0-f2a9-490d-870c-341cbe4a08a9 req-9892430f-e699-456a-9fc8-b274b79cd423 service nova] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-441de6f0-f2a9-490d-870c-341cbe4a08a9 req-9892430f-e699-456a-9fc8-b274b79cd423 service nova] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-441de6f0-f2a9-490d-870c-341cbe4a08a9 req-9892430f-e699-456a-9fc8-b274b79cd423 service nova] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-441de6f0-f2a9-490d-870c-341cbe4a08a9 req-9892430f-e699-456a-9fc8-b274b79cd423 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] No waiting events found dispatching network-vif-plugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:03:02 user nova-compute[73476]: WARNING nova.compute.manager [req-441de6f0-f2a9-490d-870c-341cbe4a08a9 req-9892430f-e699-456a-9fc8-b274b79cd423 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received unexpected event network-vif-plugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 for instance with vm_state active and task_state None.
Aug 26 21:03:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 21:03:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] There are 0 instances to clean {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 21:03:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-cb1d30a1-1262-4946-b50c-d7df9ffa9788 req-b6f6178e-8378-4aed-afa8-708a3237b7c0 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-changed-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-cb1d30a1-1262-4946-b50c-d7df9ffa9788 req-b6f6178e-8378-4aed-afa8-708a3237b7c0 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Refreshing instance network info cache due to event network-changed-525b5d65-8ad1-445d-aa94-091fe68cbc0f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:03:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cb1d30a1-1262-4946-b50c-d7df9ffa9788 req-b6f6178e-8378-4aed-afa8-708a3237b7c0 service nova] Acquiring lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:03:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cb1d30a1-1262-4946-b50c-d7df9ffa9788 req-b6f6178e-8378-4aed-afa8-708a3237b7c0 service nova] Acquired lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:03:06 user nova-compute[73476]: DEBUG nova.network.neutron [req-cb1d30a1-1262-4946-b50c-d7df9ffa9788 req-b6f6178e-8378-4aed-afa8-708a3237b7c0 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Refreshing network info cache for port 525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:03:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-cb1d30a1-1262-4946-b50c-d7df9ffa9788 req-b6f6178e-8378-4aed-afa8-708a3237b7c0 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updated VIF entry in instance network info cache for port 525b5d65-8ad1-445d-aa94-091fe68cbc0f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:03:07 user nova-compute[73476]: DEBUG nova.network.neutron [req-cb1d30a1-1262-4946-b50c-d7df9ffa9788 req-b6f6178e-8378-4aed-afa8-708a3237b7c0 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating instance_info_cache with network_info: [{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:03:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cb1d30a1-1262-4946-b50c-d7df9ffa9788 req-b6f6178e-8378-4aed-afa8-708a3237b7c0 service nova] Releasing lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:03:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:12 user nova-compute[73476]: INFO nova.compute.manager [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Shelving
Aug 26 21:03:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-afa4d8d6-c3a9-4509-bfb7-ec19822571a3 req-6f3af0d7-1798-4986-82be-d44a66c75886 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-unplugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-afa4d8d6-c3a9-4509-bfb7-ec19822571a3 req-6f3af0d7-1798-4986-82be-d44a66c75886 service nova] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-afa4d8d6-c3a9-4509-bfb7-ec19822571a3 req-6f3af0d7-1798-4986-82be-d44a66c75886 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-afa4d8d6-c3a9-4509-bfb7-ec19822571a3 req-6f3af0d7-1798-4986-82be-d44a66c75886 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-afa4d8d6-c3a9-4509-bfb7-ec19822571a3 req-6f3af0d7-1798-4986-82be-d44a66c75886 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] No waiting events found dispatching network-vif-unplugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:03:12 user nova-compute[73476]: WARNING nova.compute.manager [req-afa4d8d6-c3a9-4509-bfb7-ec19822571a3 req-6f3af0d7-1798-4986-82be-d44a66c75886 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received unexpected event network-vif-unplugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f for instance with vm_state active and task_state shelving.
Aug 26 21:03:13 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance destroyed successfully.
Aug 26 21:03:13 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Beginning cold snapshot process
Aug 26 21:03:13 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 21:03:13 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk /opt/stack/data/nova/instances/snapshots/tmpwv8j563p/30b4ead7ce1b4121a676974db6e5b2eb {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:14 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk /opt/stack/data/nova/instances/snapshots/tmpwv8j563p/30b4ead7ce1b4121a676974db6e5b2eb" returned: 0 in 0.863s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:14 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Snapshot extracted, beginning image upload
Aug 26 21:03:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-b94213f6-575a-4d0f-826b-2f4ad391f14c req-d11d1282-2629-4ecb-8e13-635f607e5d3e service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b94213f6-575a-4d0f-826b-2f4ad391f14c req-d11d1282-2629-4ecb-8e13-635f607e5d3e service nova] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b94213f6-575a-4d0f-826b-2f4ad391f14c req-d11d1282-2629-4ecb-8e13-635f607e5d3e service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b94213f6-575a-4d0f-826b-2f4ad391f14c req-d11d1282-2629-4ecb-8e13-635f607e5d3e service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-b94213f6-575a-4d0f-826b-2f4ad391f14c req-d11d1282-2629-4ecb-8e13-635f607e5d3e service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] No waiting events found dispatching network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:03:14 user nova-compute[73476]: WARNING nova.compute.manager [req-b94213f6-575a-4d0f-826b-2f4ad391f14c req-d11d1282-2629-4ecb-8e13-635f607e5d3e service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received unexpected event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 21:03:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Snapshot image upload complete
Aug 26 21:03:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:03:16 user nova-compute[73476]: INFO nova.compute.manager [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Shelve offloading
Aug 26 21:03:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance destroyed successfully.
Aug 26 21:03:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:03:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:03:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquired lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:03:16 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:03:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating instance_info_cache with network_info: [{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:03:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Releasing lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:03:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance destroyed successfully.
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.objects.instance [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'resources' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-891897880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-891897880',id=37,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkKX5RWHWnNaFPRwccSTJZClKfJCvxst9NrrwQIMgyEW01AEls4K3rtrSmyQitd/fHtBfBqYkZ8HNxZQAuEcfvKwbMHrWqgyAz98mLqVupumo0rYWaL5lDWnYqtiVxfSg==',key_name='tempest-keypair-1143520029',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-o05zd9bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member',shelved_at='2023-08-26T21:03:16.795308',shelved_host='user',shelved_image_id='d54087c6-068a-4b93-80bd-3dc62a096f7d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=dadb69ec-5163-4e65-9656-3b80ee51fdf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG os_vif [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525b5d65-8a, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:03:18 user nova-compute[73476]: INFO os_vif [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a')
Aug 26 21:03:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Deleting instance files /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0_del
Aug 26 21:03:18 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Deletion of /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0_del complete
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.compute.manager [req-51369842-f349-4e9c-84d2-9415006f5744 req-4b51dc62-b80b-4610-b585-ffa3d531c50b service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-changed-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.compute.manager [req-51369842-f349-4e9c-84d2-9415006f5744 req-4b51dc62-b80b-4610-b585-ffa3d531c50b service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Refreshing instance network info cache due to event network-changed-525b5d65-8ad1-445d-aa94-091fe68cbc0f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-51369842-f349-4e9c-84d2-9415006f5744 req-4b51dc62-b80b-4610-b585-ffa3d531c50b service nova] Acquiring lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-51369842-f349-4e9c-84d2-9415006f5744 req-4b51dc62-b80b-4610-b585-ffa3d531c50b service nova] Acquired lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.network.neutron [req-51369842-f349-4e9c-84d2-9415006f5744 req-4b51dc62-b80b-4610-b585-ffa3d531c50b service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Refreshing network info cache for port 525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:03:18 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Deleted allocations for instance dadb69ec-5163-4e65-9656-3b80ee51fdf0
Aug 26 21:03:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.objects.instance [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'numa_topology' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.objects.base [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<dadb69ec-5163-4e65-9656-3b80ee51fdf0> lazy-loaded attributes: resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b9e65a2b-012b-4ea9-8696-9ec451da561c tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.576s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:19 user nova-compute[73476]: DEBUG nova.network.neutron [req-51369842-f349-4e9c-84d2-9415006f5744 req-4b51dc62-b80b-4610-b585-ffa3d531c50b service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updated VIF entry in instance network info cache for port 525b5d65-8ad1-445d-aa94-091fe68cbc0f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:03:19 user nova-compute[73476]: DEBUG nova.network.neutron [req-51369842-f349-4e9c-84d2-9415006f5744 req-4b51dc62-b80b-4610-b585-ffa3d531c50b service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating instance_info_cache with network_info: [{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap525b5d65-8a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:03:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-51369842-f349-4e9c-84d2-9415006f5744 req-4b51dc62-b80b-4610-b585-ffa3d531c50b service nova] Releasing lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:03:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:28 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083793.162854, dadb69ec-5163-4e65-9656-3b80ee51fdf0 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:03:28 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] VM Stopped (Lifecycle Event)
Aug 26 21:03:28 user nova-compute[73476]: DEBUG nova.compute.manager [None req-62ed9cd8-a8e8-4357-a1ac-5f241f55d296 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:03:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-bf29c74e-ca54-4b41-9bf1-7c8ef06f92d3 req-93d0c21b-f366-406f-834f-5a678f186cad service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-changed-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:28 user nova-compute[73476]: DEBUG nova.compute.manager [req-bf29c74e-ca54-4b41-9bf1-7c8ef06f92d3 req-93d0c21b-f366-406f-834f-5a678f186cad service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Refreshing instance network info cache due to event network-changed-64288b3e-9d2a-4c14-9a96-308182a1bf4b. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:03:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bf29c74e-ca54-4b41-9bf1-7c8ef06f92d3 req-93d0c21b-f366-406f-834f-5a678f186cad service nova] Acquiring lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:03:28 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bf29c74e-ca54-4b41-9bf1-7c8ef06f92d3 req-93d0c21b-f366-406f-834f-5a678f186cad service nova] Acquired lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:03:28 user nova-compute[73476]: DEBUG nova.network.neutron [req-bf29c74e-ca54-4b41-9bf1-7c8ef06f92d3 req-93d0c21b-f366-406f-834f-5a678f186cad service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Refreshing network info cache for port 64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:03:28 user nova-compute[73476]: DEBUG nova.network.neutron [req-bf29c74e-ca54-4b41-9bf1-7c8ef06f92d3 req-93d0c21b-f366-406f-834f-5a678f186cad service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updated VIF entry in instance network info cache for port 64288b3e-9d2a-4c14-9a96-308182a1bf4b. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:03:28 user nova-compute[73476]: DEBUG nova.network.neutron [req-bf29c74e-ca54-4b41-9bf1-7c8ef06f92d3 req-93d0c21b-f366-406f-834f-5a678f186cad service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating instance_info_cache with network_info: [{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:03:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bf29c74e-ca54-4b41-9bf1-7c8ef06f92d3 req-93d0c21b-f366-406f-834f-5a678f186cad service nova] Releasing lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:03:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-0db90170-9a46-42ef-b0ea-ce44d14ccb04 req-3ffb40b5-2d73-43cb-a25a-78e1b8125595 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received event network-changed-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-0db90170-9a46-42ef-b0ea-ce44d14ccb04 req-3ffb40b5-2d73-43cb-a25a-78e1b8125595 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Refreshing instance network info cache due to event network-changed-62f3add4-5ee8-4a2c-befd-9848fbc2ad46. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:03:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0db90170-9a46-42ef-b0ea-ce44d14ccb04 req-3ffb40b5-2d73-43cb-a25a-78e1b8125595 service nova] Acquiring lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:03:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0db90170-9a46-42ef-b0ea-ce44d14ccb04 req-3ffb40b5-2d73-43cb-a25a-78e1b8125595 service nova] Acquired lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:03:33 user nova-compute[73476]: DEBUG nova.network.neutron [req-0db90170-9a46-42ef-b0ea-ce44d14ccb04 req-3ffb40b5-2d73-43cb-a25a-78e1b8125595 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Refreshing network info cache for port 62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG nova.network.neutron [req-0db90170-9a46-42ef-b0ea-ce44d14ccb04 req-3ffb40b5-2d73-43cb-a25a-78e1b8125595 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updated VIF entry in instance network info cache for port 62f3add4-5ee8-4a2c-befd-9848fbc2ad46. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG nova.network.neutron [req-0db90170-9a46-42ef-b0ea-ce44d14ccb04 req-3ffb40b5-2d73-43cb-a25a-78e1b8125595 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updating instance_info_cache with network_info: [{"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0db90170-9a46-42ef-b0ea-ce44d14ccb04 req-3ffb40b5-2d73-43cb-a25a-78e1b8125595 service nova] Releasing lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG nova.objects.instance [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'flavor' on Instance uuid 3639bd9f-308c-4680-b18c-0720d6f18327 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:34 user nova-compute[73476]: INFO nova.compute.manager [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Attaching volume 96a60489-9223-4e83-afea-3af848180b7e to /dev/vdb
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.utils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8ae16f-95cf-4c9e-b7a2-13f8b2724b5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a6f21c-7687-4d55-a8d2-ea96d739ae69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[39677b44-d234-4c88-b516-4252802912e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6309b45-e26e-45a1-a8f8-2f6115c81553]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:03:34 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae816146-fc13-41ad-a18a-8623ec45d91b]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.utils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updating existing volume attachment record: d8b381fc-0540-47a5-8c69-698c04299606 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG nova.objects.instance [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:34 user nova-compute[73476]: INFO nova.compute.manager [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Attaching volume 8e0751f6-3f51-43e0-a361-09a663650561 to /dev/vdb
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.utils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba8324f-70a4-4afe-8f98-316aaac8e9ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf64bf3-df10-4230-992d-3d7801b82e9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cda985-6ab1-4d15-bc34-1be63b34d622]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[458bb195-26fc-4d71-b684-4878f0e0e1c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:03:34 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:03:34 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c35986-cc77-446c-91f9-97fa38f2c78e]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG os_brick.utils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:03:34 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating existing volume attachment record: ddfec89e-ace4-4390-a6e5-d1a68c99baa3 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:03:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "5fd9668d-011b-429c-8021-c0296dbeee0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:36 user nova-compute[73476]: INFO nova.compute.manager [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Terminating instance
Aug 26 21:03:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:03:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-8f891572-d452-4290-97c6-bc36b14f2bac req-71910354-9a36-411d-9505-06f082b3e044 service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received event network-vif-unplugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8f891572-d452-4290-97c6-bc36b14f2bac req-71910354-9a36-411d-9505-06f082b3e044 service nova] Acquiring lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8f891572-d452-4290-97c6-bc36b14f2bac req-71910354-9a36-411d-9505-06f082b3e044 service nova] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8f891572-d452-4290-97c6-bc36b14f2bac req-71910354-9a36-411d-9505-06f082b3e044 service nova] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-8f891572-d452-4290-97c6-bc36b14f2bac req-71910354-9a36-411d-9505-06f082b3e044 service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] No waiting events found dispatching network-vif-unplugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG nova.compute.manager [req-8f891572-d452-4290-97c6-bc36b14f2bac req-71910354-9a36-411d-9505-06f082b3e044 service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received event network-vif-unplugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Instance destroyed successfully.
Aug 26 21:03:37 user nova-compute[73476]: DEBUG nova.objects.instance [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lazy-loading 'resources' on Instance uuid 5fd9668d-011b-429c-8021-c0296dbeee0a {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-676941162',display_name='tempest-ServersNegativeTestJSON-server-676941162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-676941162',id=40,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8898a711cbc44ce3927e58efdcc04106',ramdisk_id='',reservation_id='r-370sq6dn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-969438150',owner_user_name='tempest-ServersNegativeTestJSON-969438150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:01:54Z,user_data=None,user_id='6561f885aedc4f3babc29d0d887cebf6',uuid=5fd9668d-011b-429c-8021-c0296dbeee0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converting VIF {"id": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "address": "fa:16:3e:1f:7f:d4", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5a7d7a-91", "ovs_interfaceid": "fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7f:d4,bridge_name='br-int',has_traffic_filtering=True,id=fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5a7d7a-91') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG os_vif [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7f:d4,bridge_name='br-int',has_traffic_filtering=True,id=fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5a7d7a-91') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc5a7d7a-91, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:37 user nova-compute[73476]: INFO os_vif [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:7f:d4,bridge_name='br-int',has_traffic_filtering=True,id=fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5a7d7a-91')
Aug 26 21:03:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Deleting instance files /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a_del
Aug 26 21:03:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Deletion of /opt/stack/data/nova/instances/5fd9668d-011b-429c-8021-c0296dbeee0a_del complete
Aug 26 21:03:37 user nova-compute[73476]: INFO nova.compute.manager [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 21:03:37 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:03:37 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:03:38 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:03:38 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Took 1.03 seconds to deallocate network for instance.
Aug 26 21:03:38 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:38 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:03:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:38 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:03:38 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:03:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:38 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Deleted allocations for instance 5fd9668d-011b-429c-8021-c0296dbeee0a
Aug 26 21:03:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-da887aea-0191-4783-bb58-3fe0fc79e827 tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.343s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-4ac0f84b-6004-4575-9437-da38a1e08537 req-a74402ed-3a17-4e13-810c-9946ad7e036a service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received event network-vif-plugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4ac0f84b-6004-4575-9437-da38a1e08537 req-a74402ed-3a17-4e13-810c-9946ad7e036a service nova] Acquiring lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4ac0f84b-6004-4575-9437-da38a1e08537 req-a74402ed-3a17-4e13-810c-9946ad7e036a service nova] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4ac0f84b-6004-4575-9437-da38a1e08537 req-a74402ed-3a17-4e13-810c-9946ad7e036a service nova] Lock "5fd9668d-011b-429c-8021-c0296dbeee0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-4ac0f84b-6004-4575-9437-da38a1e08537 req-a74402ed-3a17-4e13-810c-9946ad7e036a service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] No waiting events found dispatching network-vif-plugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:03:39 user nova-compute[73476]: WARNING nova.compute.manager [req-4ac0f84b-6004-4575-9437-da38a1e08537 req-a74402ed-3a17-4e13-810c-9946ad7e036a service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received unexpected event network-vif-plugged-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 for instance with vm_state deleted and task_state None.
Aug 26 21:03:39 user nova-compute[73476]: DEBUG nova.compute.manager [req-4ac0f84b-6004-4575-9437-da38a1e08537 req-a74402ed-3a17-4e13-810c-9946ad7e036a service nova] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Received event network-vif-deleted-fc5a7d7a-9116-446a-82f0-6c4fe7e9d6f0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:41 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:41 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnoxfZVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:03:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:03:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:03:45 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ea93be-b01f-4396-ac20-d39b3bfbf4b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:03:45 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5c378f-bd33-47a8-81c7-1db1865e22bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e] added
Aug 26 21:03:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e569b2-6cb0-4b56-bfc1-feebbcdb90fd]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db9d795-d63d-4c0e-be39-1a1cfb0f9fc3]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnoxfZVg {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnoxfZVg" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3cab9d-93f4-4bc6-be73-cba8e5aade7e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LnoxfZVg'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[058cea07-9bdf-4067-b8b3-2a447f77384d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f5beb6-6c7c-405d-acbc-3e0c0b56eaaa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 21:03:45 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 21:03:45 user nova-compute[73476]:  {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:03:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 21:03:45 user nova-compute[73476]: 
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c155b5-a37d-4561-8bfe-10ea71ccead7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e, portal: 172.16.0.220,3260]
Aug 26 21:03:45 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e, portal: 172.16.0.220,3260] successful.
Aug 26 21:03:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6272cfd-e16d-4229-b919-402827268285]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a243b798-a704-488d-9366-98ed168b7f44]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)
Aug 26 21:03:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)
Aug 26 21:03:45 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb2c5e-c9af-429c-8ce4-3e7189a9d482]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzDMoRha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:03:45 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:03:45 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "f3ab142f-91a1-45d5-a133-f922d782ac8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:45 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:03:45 user nova-compute[73476]: INFO nova.compute.claims [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Claim successful on node user
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:03:46 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:03:46 user nova-compute[73476]: INFO nova.virt.block_device [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Booting with volume snapshot e138b27d-6140-4c3d-92b6-c4232afc0af6 at /dev/vda
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.policy [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bb1fc1180d34eb0ae98c52187aae87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1962b32d78d4f6da29bb0fdaa001363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnoxfZVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26339376136636238', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339376136636238', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.779s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:03:46 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:03:46 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.objects.instance [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'flavor' on Instance uuid 3639bd9f-308c-4680-b18c-0720d6f18327 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb4647a-5562-4280-9cd5-6a071e6f1092]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:03:46 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:03:46 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:03:46 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 21:03:46 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:03:46 user nova-compute[73476]:   <serial>96a60489-9223-4e83-afea-3af848180b7e</serial>
Aug 26 21:03:46 user nova-compute[73476]: </disk>
Aug 26 21:03:46 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e510228d-d13e-4638-8d95-79819796a241]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561] added
Aug 26 21:03:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a283c-3e4c-493a-a902-8b2ff596dd8d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21b6fe6-095b-491d-9059-667b59166767]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzDMoRha {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzDMoRha" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf0deb9-4bb7-4a6a-8a1f-ea2a3be8253c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IzDMoRha'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b530f794-652c-4ea8-ad18-1d6829d054e8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4440d76d-ca5e-4f6b-9c05-64b627b5b7c3]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)
Aug 26 21:03:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)
Aug 26 21:03:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75370f0-0c88-462f-8c1e-61ce8546f112]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260]
Aug 26 21:03:46 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260] successful.
Aug 26 21:03:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5a7d48-6052-42af-ad15-6763b096452f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deb2d43-35a8-49f9-bb9c-b3e5af7aaf61]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)
Aug 26 21:03:46 user nova-compute[73476]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:03:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)
Aug 26 21:03:46 user nova-compute[73476]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:03:46 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b56f40-4bed-4758-aa85-e8cf72c37062]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:03:46 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No VIF found with MAC fa:16:3e:47:fa:70, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-87462950-376a-4408-a0f6-5a462da5b875 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.853s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Successfully created port: 69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzDMoRha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== connect_volume: return (2083ms) {'type': 'block', 'scsi_wwn': '23963326335633132', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963326335633132', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:03:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:03:47 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:03:47 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:03:47 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:03:47 user nova-compute[73476]:   <serial>8e0751f6-3f51-43e0-a361-09a663650561</serial>
Aug 26 21:03:47 user nova-compute[73476]: </disk>
Aug 26 21:03:47 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Successfully updated port: 69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "refresh_cache-f3ab142f-91a1-45d5-a133-f922d782ac8c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquired lock "refresh_cache-f3ab142f-91a1-45d5-a133-f922d782ac8c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-3822b4ea-8b3e-4aa3-933f-ec54274aa8bc req-8ba7c99e-b846-4f1c-ae5f-d231fe5deafd service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received event network-changed-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-3822b4ea-8b3e-4aa3-933f-ec54274aa8bc req-8ba7c99e-b846-4f1c-ae5f-d231fe5deafd service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Refreshing instance network info cache due to event network-changed-69a3ba5e-663b-4d88-a9b3-fd92a1502a49. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3822b4ea-8b3e-4aa3-933f-ec54274aa8bc req-8ba7c99e-b846-4f1c-ae5f-d231fe5deafd service nova] Acquiring lock "refresh_cache-f3ab142f-91a1-45d5-a133-f922d782ac8c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No VIF found with MAC fa:16:3e:40:fb:89, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8db2d0e5-c8cf-4e8d-a210-4e4f345260b2 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.696s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Updating instance_info_cache with network_info: [{"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Releasing lock "refresh_cache-f3ab142f-91a1-45d5-a133-f922d782ac8c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Instance network_info: |[{"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3822b4ea-8b3e-4aa3-933f-ec54274aa8bc req-8ba7c99e-b846-4f1c-ae5f-d231fe5deafd service nova] Acquired lock "refresh_cache-f3ab142f-91a1-45d5-a133-f922d782ac8c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-3822b4ea-8b3e-4aa3-933f-ec54274aa8bc req-8ba7c99e-b846-4f1c-ae5f-d231fe5deafd service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Refreshing network info cache for port 69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4da03458-339e-49b7-8dee-2632830cd513 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4da03458-339e-49b7-8dee-2632830cd513 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4da03458-339e-49b7-8dee-2632830cd513 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4da03458-339e-49b7-8dee-2632830cd513 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73476) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4da03458-339e-49b7-8dee-2632830cd513 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-3822b4ea-8b3e-4aa3-933f-ec54274aa8bc req-8ba7c99e-b846-4f1c-ae5f-d231fe5deafd service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Updated VIF entry in instance network info cache for port 69a3ba5e-663b-4d88-a9b3-fd92a1502a49. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:03:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-3822b4ea-8b3e-4aa3-933f-ec54274aa8bc req-8ba7c99e-b846-4f1c-ae5f-d231fe5deafd service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Updating instance_info_cache with network_info: [{"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:03:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3822b4ea-8b3e-4aa3-933f-ec54274aa8bc req-8ba7c99e-b846-4f1c-ae5f-d231fe5deafd service nova] Releasing lock "refresh_cache-f3ab142f-91a1-45d5-a133-f922d782ac8c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:03:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance destroyed successfully.
Aug 26 21:03:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4da03458-339e-49b7-8dee-2632830cd513 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:03:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4da03458-339e-49b7-8dee-2632830cd513 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.868s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:49 user nova-compute[73476]: INFO nova.compute.manager [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Detaching volume 96a60489-9223-4e83-afea-3af848180b7e
Aug 26 21:03:50 user nova-compute[73476]: INFO nova.virt.block_device [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Attempting to driver detach volume 96a60489-9223-4e83-afea-3af848180b7e from mountpoint /dev/vdb
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Attempting to detach device vdb from instance 3639bd9f-308c-4680-b18c-0720d6f18327 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:03:50 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:03:50 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 21:03:50 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:03:50 user nova-compute[73476]:   <serial>96a60489-9223-4e83-afea-3af848180b7e</serial>
Aug 26 21:03:50 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:03:50 user nova-compute[73476]: </disk>
Aug 26 21:03:50 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:03:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Successfully detached device vdb from instance 3639bd9f-308c-4680-b18c-0720d6f18327 from the persistent domain config.
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3639bd9f-308c-4680-b18c-0720d6f18327 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:03:50 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:03:50 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 21:03:50 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:03:50 user nova-compute[73476]:   <serial>96a60489-9223-4e83-afea-3af848180b7e</serial>
Aug 26 21:03:50 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:03:50 user nova-compute[73476]: </disk>
Aug 26 21:03:50 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-unplugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-unplugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:03:50 user nova-compute[73476]: WARNING nova.compute.manager [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-unplugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state stopped and task_state None.
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:03:50 user nova-compute[73476]: WARNING nova.compute.manager [req-a907d2f7-4c44-48c8-909e-612b30ab6e01 req-b1092572-6079-46d3-9412-b5a735850dfb service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state stopped and task_state None.
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083830.5355334, 3639bd9f-308c-4680-b18c-0720d6f18327 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3639bd9f-308c-4680-b18c-0720d6f18327 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:03:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Successfully detached device vdb from instance 3639bd9f-308c-4680-b18c-0720d6f18327 from the live domain config.
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnoxfZVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:03:50 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89bcbbc-c780-4c70-8496-580bd43ac4f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e0eded-81ff-43e4-87f4-d9fec9830994]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)
Aug 26 21:03:50 user nova-compute[73476]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:03:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e (non-flash)
Aug 26 21:03:50 user nova-compute[73476]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:03:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d01c3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[828ac65a-e948-40f4-b0ba-6e3c6875dd68]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e22c1da-d8f1-4ed6-84bf-248a065f819a]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e866b-2db7-415b-b341-6de805ce7d8e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc3e84-fc16-4b3b-aba5-db1cd0459262]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[970b13df-5672-4fd1-87c4-01474d66144a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8313a8b2-743d-4b23-880d-0e0784469194]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e, portal: 172.16.0.220,3260]
Aug 26 21:03:50 user nova-compute[73476]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e, portal: 172.16.0.220,3260] successful.
Aug 26 21:03:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a60489-9223-4e83-afea-3af848180b7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2c1828-9eef-4b40-a791-63dab749de84]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] <== disconnect_volume: return (265ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:03:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating instance_info_cache with network_info: [{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'flavor' on Instance uuid 3639bd9f-308c-4680-b18c-0720d6f18327 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4019fd30-abe8-4c9d-a050-27590ad0d898 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.722s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG os_brick.utils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53e48c2-7e14-45c7-bb5f-c4cb3632bdb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d468ce07-4410-4fe8-9ace-68696968b964]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6953c02-390a-4ca7-8a2c-9b5182bcd163]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6061dd12-7bf1-40fb-a800-974b5673ffab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:03:52 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[520bca41-df86-437c-84f5-b37471e16b20]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG os_brick.utils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Updating existing volume attachment record: b02b0af0-4ad6-400f-abcb-e85911622c00 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083817.5231626, 5fd9668d-011b-429c-8021-c0296dbeee0a => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:03:52 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] VM Stopped (Lifecycle Event)
Aug 26 21:03:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f46edf18-8f68-434c-aed0-3a1d58d37b8d None None] [instance: 5fd9668d-011b-429c-8021-c0296dbeee0a] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:03:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:03:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8312MB free_disk=25.180644989013672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3639bd9f-308c-4680-b18c-0720d6f18327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance b699d711-cfff-4095-a9fe-e6ad1bad94eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance f3ab142f-91a1-45d5-a133-f922d782ac8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:03:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:03:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:03:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:04:02 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Creating image(s)
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Ensure instance console log exists: /opt/stack/data/nova/instances/f3ab142f-91a1-45d5-a133-f922d782ac8c/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Start _get_guest_xml network_info=[{"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'b02b0af0-4ad6-400f-abcb-e85911622c00', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkWmKPVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3ab142f-91a1-45d5-a133-f922d782ac8c', 'attached_at': '', 'detached_at': '', 'volume_id': '7f3d1d77-9e12-421b-80ac-df8bb99d46be', 'serial': '7f3d1d77-9e12-421b-80ac-df8bb99d46be'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:04:02 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:04:02 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkWmKPVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:04:02 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:04:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:04:02 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:04:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:04:02 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a36841-1057-40ff-a936-0a450c6a5e60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:04:02 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0566b7fb-186d-4f57-becd-75b46b4d8f46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be] added
Aug 26 21:04:02 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d86e17-3fea-4e59-88fd-a694c4eddd61]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad9d38d-e102-442f-9e41-a0259f540208]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkWmKPVg {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkWmKPVg" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c2ae66-915d-408e-b05a-91c9427f02a4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bkWmKPVg'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9df705-55be-4726-90f8-e32d9c1150af]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f724f1cc-bac6-482e-9abd-fc6e5358a508]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:04:03 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:04:03 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecf3a98-ca49-4bcc-b8df-3a94c339c9cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be, portal: 172.16.0.220,3260]
Aug 26 21:04:03 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be, portal: 172.16.0.220,3260] successful.
Aug 26 21:04:03 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a18d7d-0d30-4bef-b383-7b44fe226eb5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8caca9-78dc-4f17-8ab3-eb454e46b22d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:04:03 user nova-compute[73476]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)
Aug 26 21:04:03 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:04:03 user nova-compute[73476]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)
Aug 26 21:04:03 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1095aab1-f184-466f-83dc-ac7f4de3a2e9]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:03 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkWmKPVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26135373139656365', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135373139656365', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1101542102',display_name='tempest-TestVolumeBootPattern-server-1101542102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1101542102',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-j2dbpxhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:03:46Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=f3ab142f-91a1-45d5-a133-f922d782ac8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:be,bridge_name='br-int',has_traffic_filtering=True,id=69a3ba5e-663b-4d88-a9b3-fd92a1502a49,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a3ba5e-66') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'pci_devices' on Instance uuid f3ab142f-91a1-45d5-a133-f922d782ac8c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:04:04 user nova-compute[73476]:   <uuid>f3ab142f-91a1-45d5-a133-f922d782ac8c</uuid>
Aug 26 21:04:04 user nova-compute[73476]:   <name>instance-0000002a</name>
Aug 26 21:04:04 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:04:04 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:04:04 user nova-compute[73476]:   <metadata>
Aug 26 21:04:04 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:04:04 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:04:04 user nova-compute[73476]:       <nova:name>tempest-TestVolumeBootPattern-server-1101542102</nova:name>
Aug 26 21:04:04 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:04:02</nova:creationTime>
Aug 26 21:04:04 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:04:04 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:04:04 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:04:04 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:04:04 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:04:04 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:04:04 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:04:04 user nova-compute[73476]:       <nova:owner>
Aug 26 21:04:04 user nova-compute[73476]:         <nova:user uuid="5bb1fc1180d34eb0ae98c52187aae87e">tempest-TestVolumeBootPattern-443030295-project-member</nova:user>
Aug 26 21:04:04 user nova-compute[73476]:         <nova:project uuid="a1962b32d78d4f6da29bb0fdaa001363">tempest-TestVolumeBootPattern-443030295</nova:project>
Aug 26 21:04:04 user nova-compute[73476]:       </nova:owner>
Aug 26 21:04:04 user nova-compute[73476]:       <nova:ports>
Aug 26 21:04:04 user nova-compute[73476]:         <nova:port uuid="69a3ba5e-663b-4d88-a9b3-fd92a1502a49">
Aug 26 21:04:04 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 21:04:04 user nova-compute[73476]:         </nova:port>
Aug 26 21:04:04 user nova-compute[73476]:       </nova:ports>
Aug 26 21:04:04 user nova-compute[73476]:     </nova:instance>
Aug 26 21:04:04 user nova-compute[73476]:   </metadata>
Aug 26 21:04:04 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:04:04 user nova-compute[73476]:     <system>
Aug 26 21:04:04 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:04:04 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:04:04 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:04:04 user nova-compute[73476]:       <entry name="serial">f3ab142f-91a1-45d5-a133-f922d782ac8c</entry>
Aug 26 21:04:04 user nova-compute[73476]:       <entry name="uuid">f3ab142f-91a1-45d5-a133-f922d782ac8c</entry>
Aug 26 21:04:04 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:04:04 user nova-compute[73476]:     </system>
Aug 26 21:04:04 user nova-compute[73476]:   </sysinfo>
Aug 26 21:04:04 user nova-compute[73476]:   <os>
Aug 26 21:04:04 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:04:04 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:04:04 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:04:04 user nova-compute[73476]:   </os>
Aug 26 21:04:04 user nova-compute[73476]:   <features>
Aug 26 21:04:04 user nova-compute[73476]:     <acpi/>
Aug 26 21:04:04 user nova-compute[73476]:     <apic/>
Aug 26 21:04:04 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:04:04 user nova-compute[73476]:   </features>
Aug 26 21:04:04 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:04:04 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:04:04 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:04:04 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:04:04 user nova-compute[73476]:   </clock>
Aug 26 21:04:04 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:04:04 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:04:04 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:04:04 user nova-compute[73476]:   </cpu>
Aug 26 21:04:04 user nova-compute[73476]:   <devices>
Aug 26 21:04:04 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 21:04:04 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:04:04 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 21:04:04 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:04:04 user nova-compute[73476]:       <serial>7f3d1d77-9e12-421b-80ac-df8bb99d46be</serial>
Aug 26 21:04:04 user nova-compute[73476]:     </disk>
Aug 26 21:04:04 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:04:04 user nova-compute[73476]:       <mac address="fa:16:3e:9d:25:be"/>
Aug 26 21:04:04 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:04:04 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:04:04 user nova-compute[73476]:       <target dev="tap69a3ba5e-66"/>
Aug 26 21:04:04 user nova-compute[73476]:     </interface>
Aug 26 21:04:04 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:04:04 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/f3ab142f-91a1-45d5-a133-f922d782ac8c/console.log" append="off"/>
Aug 26 21:04:04 user nova-compute[73476]:     </serial>
Aug 26 21:04:04 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:04:04 user nova-compute[73476]:     <video>
Aug 26 21:04:04 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:04:04 user nova-compute[73476]:     </video>
Aug 26 21:04:04 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:04:04 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:04:04 user nova-compute[73476]:     </rng>
Aug 26 21:04:04 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:04:04 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:04:04 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:04:04 user nova-compute[73476]:     </memballoon>
Aug 26 21:04:04 user nova-compute[73476]:   </devices>
Aug 26 21:04:04 user nova-compute[73476]: </domain>
Aug 26 21:04:04 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1101542102',display_name='tempest-TestVolumeBootPattern-server-1101542102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1101542102',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-j2dbpxhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:03:46Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=f3ab142f-91a1-45d5-a133-f922d782ac8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:be,bridge_name='br-int',has_traffic_filtering=True,id=69a3ba5e-663b-4d88-a9b3-fd92a1502a49,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a3ba5e-66') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG os_vif [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:be,bridge_name='br-int',has_traffic_filtering=True,id=69a3ba5e-663b-4d88-a9b3-fd92a1502a49,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a3ba5e-66') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69a3ba5e-66, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69a3ba5e-66, col_values=(('external_ids', {'iface-id': '69a3ba5e-663b-4d88-a9b3-fd92a1502a49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:25:be', 'vm-uuid': 'f3ab142f-91a1-45d5-a133-f922d782ac8c'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:04 user nova-compute[73476]: INFO os_vif [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:be,bridge_name='br-int',has_traffic_filtering=True,id=69a3ba5e-663b-4d88-a9b3-fd92a1502a49,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a3ba5e-66')
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No VIF found with MAC fa:16:3e:9d:25:be, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083829.6912804, 7d07fece-58a4-46ec-902c-f1506956d1fa => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:04:04 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] VM Stopped (Lifecycle Event)
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-26b15115-2b27-40a4-b47e-8bf96417676a None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:04:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-26b15115-2b27-40a4-b47e-8bf96417676a None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-09a2d79e-a17b-4bf1-99f5-139f3fa762ec req-1c693824-c577-4aef-bd2b-9911a0ed3324 service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received event network-vif-plugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-09a2d79e-a17b-4bf1-99f5-139f3fa762ec req-1c693824-c577-4aef-bd2b-9911a0ed3324 service nova] Acquiring lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-09a2d79e-a17b-4bf1-99f5-139f3fa762ec req-1c693824-c577-4aef-bd2b-9911a0ed3324 service nova] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-09a2d79e-a17b-4bf1-99f5-139f3fa762ec req-1c693824-c577-4aef-bd2b-9911a0ed3324 service nova] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:04:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-09a2d79e-a17b-4bf1-99f5-139f3fa762ec req-1c693824-c577-4aef-bd2b-9911a0ed3324 service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] No waiting events found dispatching network-vif-plugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:04:05 user nova-compute[73476]: WARNING nova.compute.manager [req-09a2d79e-a17b-4bf1-99f5-139f3fa762ec req-1c693824-c577-4aef-bd2b-9911a0ed3324 service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received unexpected event network-vif-plugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 for instance with vm_state building and task_state spawning.
Aug 26 21:04:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083847.6683345, f3ab142f-91a1-45d5-a133-f922d782ac8c => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:04:07 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] VM Resumed (Lifecycle Event)
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:04:07 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Instance spawned successfully.
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:04:07 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083847.6705098, f3ab142f-91a1-45d5-a133-f922d782ac8c => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:04:07 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] VM Started (Lifecycle Event)
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:04:07 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:04:07 user nova-compute[73476]: INFO nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:04:07 user nova-compute[73476]: INFO nova.compute.manager [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Took 22.00 seconds to build instance.
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-079876ba-a587-4532-ba45-bf6cd4c0e0c0 req-eeac042a-7414-4fe0-8801-beb335c4945c service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received event network-vif-plugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-079876ba-a587-4532-ba45-bf6cd4c0e0c0 req-eeac042a-7414-4fe0-8801-beb335c4945c service nova] Acquiring lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-079876ba-a587-4532-ba45-bf6cd4c0e0c0 req-eeac042a-7414-4fe0-8801-beb335c4945c service nova] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-079876ba-a587-4532-ba45-bf6cd4c0e0c0 req-eeac042a-7414-4fe0-8801-beb335c4945c service nova] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:04:07 user nova-compute[73476]: DEBUG nova.compute.manager [req-079876ba-a587-4532-ba45-bf6cd4c0e0c0 req-eeac042a-7414-4fe0-8801-beb335c4945c service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] No waiting events found dispatching network-vif-plugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:04:07 user nova-compute[73476]: WARNING nova.compute.manager [req-079876ba-a587-4532-ba45-bf6cd4c0e0c0 req-eeac042a-7414-4fe0-8801-beb335c4945c service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received unexpected event network-vif-plugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 for instance with vm_state active and task_state None.
Aug 26 21:04:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d6cdff8e-41b0-4d39-bf1d-9a93f29a007d tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.085s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:04:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:04:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:04:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:04:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:04:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:04:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:04:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:04:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-0a9a72bd-a996-406b-9f1c-8b9dfdec9867 req-7198c291-7295-48c2-b368-64469e5fc811 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received event network-changed-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:04:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-0a9a72bd-a996-406b-9f1c-8b9dfdec9867 req-7198c291-7295-48c2-b368-64469e5fc811 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Refreshing instance network info cache due to event network-changed-c3b18763-d863-4a04-879e-1de60aa7e6a0. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:04:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0a9a72bd-a996-406b-9f1c-8b9dfdec9867 req-7198c291-7295-48c2-b368-64469e5fc811 service nova] Acquiring lock "refresh_cache-b699d711-cfff-4095-a9fe-e6ad1bad94eb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:04:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0a9a72bd-a996-406b-9f1c-8b9dfdec9867 req-7198c291-7295-48c2-b368-64469e5fc811 service nova] Acquired lock "refresh_cache-b699d711-cfff-4095-a9fe-e6ad1bad94eb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:04:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-0a9a72bd-a996-406b-9f1c-8b9dfdec9867 req-7198c291-7295-48c2-b368-64469e5fc811 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Refreshing network info cache for port c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'flavor' on Instance uuid b699d711-cfff-4095-a9fe-e6ad1bad94eb {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:04:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Ignoring supplied device name: /dev/vdb
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:47 user nova-compute[73476]: INFO nova.compute.manager [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Attaching volume 20774b19-0803-472d-b055-283ae309d2c4 to /dev/vdb
Aug 26 21:04:47 user nova-compute[73476]: DEBUG os_brick.utils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6540b439-38c8-49d4-805f-14244e5ff5df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[785bcbfb-4640-4e09-ac37-abbd05e0fca9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b37b3e-62f5-4ec8-b99e-6ad4f74ca1fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec7b562-d1c4-4d7a-9454-6a5dabfa3164]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:04:47 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ac3f7c-0eb5-4b79-a404-b732175c67e6]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG os_brick.utils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Updating existing volume attachment record: 7e76e1e2-64a7-4581-a6fb-e106b83e4f09 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG nova.network.neutron [req-0a9a72bd-a996-406b-9f1c-8b9dfdec9867 req-7198c291-7295-48c2-b368-64469e5fc811 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Updated VIF entry in instance network info cache for port c3b18763-d863-4a04-879e-1de60aa7e6a0. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG nova.network.neutron [req-0a9a72bd-a996-406b-9f1c-8b9dfdec9867 req-7198c291-7295-48c2-b368-64469e5fc811 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Updating instance_info_cache with network_info: [{"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:04:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-0a9a72bd-a996-406b-9f1c-8b9dfdec9867 req-7198c291-7295-48c2-b368-64469e5fc811 service nova] Releasing lock "refresh_cache-b699d711-cfff-4095-a9fe-e6ad1bad94eb" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:04:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:04:49 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:04:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:04:50 user nova-compute[73476]: INFO nova.compute.manager [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] instance snapshotting
Aug 26 21:04:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:04:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:04:50 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:04:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Beginning live snapshot process
Aug 26 21:04:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json -f qcow2 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json -f qcow2 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjns69whv/3766e41f3f8e4943bf89bb2b45c2aba3.delta 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjns69whv/3766e41f3f8e4943bf89bb2b45c2aba3.delta 1073741824" returned: 0 in 0.049s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:04:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:04:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 21:04:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73476) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 21:04:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 21:04:52 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:04:52 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:04:52 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8256MB free_disk=25.163211822509766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:04:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjns69whv/3766e41f3f8e4943bf89bb2b45c2aba3.delta /opt/stack/data/nova/instances/snapshots/tmpjns69whv/3766e41f3f8e4943bf89bb2b45c2aba3 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3639bd9f-308c-4680-b18c-0720d6f18327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance b699d711-cfff-4095-a9fe-e6ad1bad94eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance f3ab142f-91a1-45d5-a133-f922d782ac8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:04:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjns69whv/3766e41f3f8e4943bf89bb2b45c2aba3.delta /opt/stack/data/nova/instances/snapshots/tmpjns69whv/3766e41f3f8e4943bf89bb2b45c2aba3" returned: 0 in 0.754s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:53 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Snapshot extracted, beginning image upload
Aug 26 21:04:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:54 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:04:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:04:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:04:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:04:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:04:54 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:04:54 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:04:54 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updating instance_info_cache with network_info: [{"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:04:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:04:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:04:55 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:04:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:55 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Snapshot image upload complete
Aug 26 21:04:55 user nova-compute[73476]: INFO nova.compute.manager [None req-fb63ecc9-4537-4a1c-b291-b4a94fab86ce tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Took 5.31 seconds to snapshot the instance on the hypervisor.
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnVQSuhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:04:58 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:04:58 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:04:58 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:04:58 user nova-compute[73476]: INFO nova.compute.claims [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Claim successful on node user
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bc4d9b-35f9-49c5-8820-99cadae7b554]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:04:58 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[72179df8-a750-4ee1-84b2-40c764614e07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4] added
Aug 26 21:04:58 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[985bec77-dd6a-4a14-b137-dd236500a59a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f24f344-ccb9-4514-beb6-43f7d44a1557]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnVQSuhK {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnVQSuhK" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1386c11d-231a-4b56-89f0-073b96c60a01]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AnVQSuhK'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecccdcd9-5a6a-4406-9ddc-c51573a877ea]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b94842f-1eeb-425b-8efd-c59e89f0c3f3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:04:58 user nova-compute[73476]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)
Aug 26 21:04:58 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:04:58 user nova-compute[73476]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)
Aug 26 21:04:58 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:04:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8da12b5-c4ba-4305-bbfe-db2cf2b02843]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4, portal: 172.16.0.220,3260]
Aug 26 21:04:59 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4, portal: 172.16.0.220,3260] successful.
Aug 26 21:04:59 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ceac8a-9261-4c35-a6df-be5c65d10072]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb17b9-cc17-43f7-b662-1a28bae92937]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:04:59 user nova-compute[73476]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)
Aug 26 21:04:59 user nova-compute[73476]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:04:59 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:04:59 user nova-compute[73476]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)
Aug 26 21:04:59 user nova-compute[73476]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:04:59 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0a92e9-0b3a-4f23-ad66-80e65c2560f6]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:04:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:04:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG nova.policy [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7600fe3f150b40b8a9905a7590aa2bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273b5f4f187d4443b5b2e563133b60b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:04:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Creating image(s)
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "/opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "/opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "280884a7f3feac6c75235b44169bb88a7576f46c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:04:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "280884a7f3feac6c75235b44169bb88a7576f46c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnVQSuhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.512s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '23632336662633265', 'path': '/dev/sdd'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632336662633265', 'path': '/dev/sdd'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Successfully created port: 696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'flavor' on Instance uuid b699d711-cfff-4095-a9fe-e6ad1bad94eb {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:05:00 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:05:00 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 21:05:00 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:05:00 user nova-compute[73476]:   <serial>20774b19-0803-472d-b055-283ae309d2c4</serial>
Aug 26 21:05:00 user nova-compute[73476]: </disk>
Aug 26 21:05:00 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c.part --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG nova.virt.images [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] 66d09f29-660a-452f-8560-f318991c06cd was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c.part /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:05:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No VIF found with MAC fa:16:3e:2b:26:f2, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c.part /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c.converted" returned: 0 in 0.793s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d44752ef-0323-48d4-901f-96f8038c0548 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.057s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "280884a7f3feac6c75235b44169bb88a7576f46c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.031s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "280884a7f3feac6c75235b44169bb88a7576f46c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "280884a7f3feac6c75235b44169bb88a7576f46c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Successfully updated port: 696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquired lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-ebca8038-6ee9-4d07-84eb-3e3898983fc9 req-bfced110-1797-4c8e-ba84-40ded7957528 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received event network-changed-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-ebca8038-6ee9-4d07-84eb-3e3898983fc9 req-bfced110-1797-4c8e-ba84-40ded7957528 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Refreshing instance network info cache due to event network-changed-696cc9bf-5a5c-4771-b808-44d0b0c7605f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ebca8038-6ee9-4d07-84eb-3e3898983fc9 req-bfced110-1797-4c8e-ba84-40ded7957528 service nova] Acquiring lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c,backing_fmt=raw /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c,backing_fmt=raw /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk 1073741824" returned: 0 in 0.049s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "280884a7f3feac6c75235b44169bb88a7576f46c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c --force-share --output=json" returned: 0 in 0.172s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Ensure instance console log exists: /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Updating instance_info_cache with network_info: [{"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Releasing lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Instance network_info: |[{"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ebca8038-6ee9-4d07-84eb-3e3898983fc9 req-bfced110-1797-4c8e-ba84-40ded7957528 service nova] Acquired lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.network.neutron [req-ebca8038-6ee9-4d07-84eb-3e3898983fc9 req-bfced110-1797-4c8e-ba84-40ded7957528 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Refreshing network info cache for port 696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Start _get_guest_xml network_info=[{"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='41ec1c4acd4b34215d88e9e4daaf73e4',container_format='bare',created_at=2023-08-26T21:04:50Z,direct_url=<?>,disk_format='qcow2',id=66d09f29-660a-452f-8560-f318991c06cd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1908431697',owner='273b5f4f187d4443b5b2e563133b60b4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T21:04:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '66d09f29-660a-452f-8560-f318991c06cd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:05:02 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:05:02 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='41ec1c4acd4b34215d88e9e4daaf73e4',container_format='bare',created_at=2023-08-26T21:04:50Z,direct_url=<?>,disk_format='qcow2',id=66d09f29-660a-452f-8560-f318991c06cd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1908431697',owner='273b5f4f187d4443b5b2e563133b60b4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T21:04:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2050043676',display_name='tempest-TestStampPattern-server-2050043676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2050043676',id=43,image_ref='66d09f29-660a-452f-8560-f318991c06cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBJxN4wvMn8Jar6NrIBiYVMiu3vgfLkl6323Mn8p765asBJjOSbk1YLZEFjYoYJLW4VOzDi5yHEmiOk8JKFOVGKLi4tNN1pZeSYxVVQ4b/Q10+a3fyslhJc+nWG56XtGA==',key_name='tempest-TestStampPattern-1984164735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='273b5f4f187d4443b5b2e563133b60b4',ramdisk_id='',reservation_id='r-l7ty1faj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3639bd9f-308c-4680-b18c-0720d6f18327',image_min_disk='1',image_min_ram='0',image_owner_id='273b5f4f187d4443b5b2e563133b60b4',image_owner_project_name='tempest-TestStampPattern-1638669422',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1638669422-project-member',image_user_id='7600fe3f150b40b8a9905a7590aa2bf2',network_allocated='True',owner_project_name='tempest-TestStampPattern-1638669422',owner_user_name='tempest-TestStampPattern-1638669422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:04:59Z,user_data=None,user_id='7600fe3f150b40b8a9905a7590aa2bf2',uuid=1d9efe64-6660-40cb-8710-c262210b5f08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converting VIF {"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:ab,bridge_name='br-int',has_traffic_filtering=True,id=696cc9bf-5a5c-4771-b808-44d0b0c7605f,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696cc9bf-5a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d9efe64-6660-40cb-8710-c262210b5f08 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:05:02 user nova-compute[73476]:   <uuid>1d9efe64-6660-40cb-8710-c262210b5f08</uuid>
Aug 26 21:05:02 user nova-compute[73476]:   <name>instance-0000002b</name>
Aug 26 21:05:02 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:05:02 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:05:02 user nova-compute[73476]:   <metadata>
Aug 26 21:05:02 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:05:02 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:05:02 user nova-compute[73476]:       <nova:name>tempest-TestStampPattern-server-2050043676</nova:name>
Aug 26 21:05:02 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:05:02</nova:creationTime>
Aug 26 21:05:02 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:05:02 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:05:02 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:05:02 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:05:02 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:05:02 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:05:02 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:05:02 user nova-compute[73476]:       <nova:owner>
Aug 26 21:05:02 user nova-compute[73476]:         <nova:user uuid="7600fe3f150b40b8a9905a7590aa2bf2">tempest-TestStampPattern-1638669422-project-member</nova:user>
Aug 26 21:05:02 user nova-compute[73476]:         <nova:project uuid="273b5f4f187d4443b5b2e563133b60b4">tempest-TestStampPattern-1638669422</nova:project>
Aug 26 21:05:02 user nova-compute[73476]:       </nova:owner>
Aug 26 21:05:02 user nova-compute[73476]:       <nova:root type="image" uuid="66d09f29-660a-452f-8560-f318991c06cd"/>
Aug 26 21:05:02 user nova-compute[73476]:       <nova:ports>
Aug 26 21:05:02 user nova-compute[73476]:         <nova:port uuid="696cc9bf-5a5c-4771-b808-44d0b0c7605f">
Aug 26 21:05:02 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 21:05:02 user nova-compute[73476]:         </nova:port>
Aug 26 21:05:02 user nova-compute[73476]:       </nova:ports>
Aug 26 21:05:02 user nova-compute[73476]:     </nova:instance>
Aug 26 21:05:02 user nova-compute[73476]:   </metadata>
Aug 26 21:05:02 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:05:02 user nova-compute[73476]:     <system>
Aug 26 21:05:02 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:05:02 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:05:02 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:05:02 user nova-compute[73476]:       <entry name="serial">1d9efe64-6660-40cb-8710-c262210b5f08</entry>
Aug 26 21:05:02 user nova-compute[73476]:       <entry name="uuid">1d9efe64-6660-40cb-8710-c262210b5f08</entry>
Aug 26 21:05:02 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:05:02 user nova-compute[73476]:     </system>
Aug 26 21:05:02 user nova-compute[73476]:   </sysinfo>
Aug 26 21:05:02 user nova-compute[73476]:   <os>
Aug 26 21:05:02 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:05:02 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:05:02 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:05:02 user nova-compute[73476]:   </os>
Aug 26 21:05:02 user nova-compute[73476]:   <features>
Aug 26 21:05:02 user nova-compute[73476]:     <acpi/>
Aug 26 21:05:02 user nova-compute[73476]:     <apic/>
Aug 26 21:05:02 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:05:02 user nova-compute[73476]:   </features>
Aug 26 21:05:02 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:05:02 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:05:02 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:05:02 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:05:02 user nova-compute[73476]:   </clock>
Aug 26 21:05:02 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:05:02 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:05:02 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:05:02 user nova-compute[73476]:   </cpu>
Aug 26 21:05:02 user nova-compute[73476]:   <devices>
Aug 26 21:05:02 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:05:02 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:05:02 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk"/>
Aug 26 21:05:02 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:05:02 user nova-compute[73476]:     </disk>
Aug 26 21:05:02 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:05:02 user nova-compute[73476]:       <mac address="fa:16:3e:6f:b8:ab"/>
Aug 26 21:05:02 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:05:02 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:05:02 user nova-compute[73476]:       <target dev="tap696cc9bf-5a"/>
Aug 26 21:05:02 user nova-compute[73476]:     </interface>
Aug 26 21:05:02 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:05:02 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/console.log" append="off"/>
Aug 26 21:05:02 user nova-compute[73476]:     </serial>
Aug 26 21:05:02 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:05:02 user nova-compute[73476]:     <video>
Aug 26 21:05:02 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:05:02 user nova-compute[73476]:     </video>
Aug 26 21:05:02 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:05:02 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:05:02 user nova-compute[73476]:     </rng>
Aug 26 21:05:02 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:05:02 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:05:02 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:05:02 user nova-compute[73476]:     </memballoon>
Aug 26 21:05:02 user nova-compute[73476]:   </devices>
Aug 26 21:05:02 user nova-compute[73476]: </domain>
Aug 26 21:05:02 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2050043676',display_name='tempest-TestStampPattern-server-2050043676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2050043676',id=43,image_ref='66d09f29-660a-452f-8560-f318991c06cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBJxN4wvMn8Jar6NrIBiYVMiu3vgfLkl6323Mn8p765asBJjOSbk1YLZEFjYoYJLW4VOzDi5yHEmiOk8JKFOVGKLi4tNN1pZeSYxVVQ4b/Q10+a3fyslhJc+nWG56XtGA==',key_name='tempest-TestStampPattern-1984164735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='273b5f4f187d4443b5b2e563133b60b4',ramdisk_id='',reservation_id='r-l7ty1faj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3639bd9f-308c-4680-b18c-0720d6f18327',image_min_disk='1',image_min_ram='0',image_owner_id='273b5f4f187d4443b5b2e563133b60b4',image_owner_project_name='tempest-TestStampPattern-1638669422',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1638669422-project-member',image_user_id='7600fe3f150b40b8a9905a7590aa2bf2',network_allocated='True',owner_project_name='tempest-TestStampPattern-1638669422',owner_user_name='tempest-TestStampPattern-1638669422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:04:59Z,user_data=None,user_id='7600fe3f150b40b8a9905a7590aa2bf2',uuid=1d9efe64-6660-40cb-8710-c262210b5f08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converting VIF {"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:ab,bridge_name='br-int',has_traffic_filtering=True,id=696cc9bf-5a5c-4771-b808-44d0b0c7605f,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696cc9bf-5a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG os_vif [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:ab,bridge_name='br-int',has_traffic_filtering=True,id=696cc9bf-5a5c-4771-b808-44d0b0c7605f,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696cc9bf-5a') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap696cc9bf-5a, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap696cc9bf-5a, col_values=(('external_ids', {'iface-id': '696cc9bf-5a5c-4771-b808-44d0b0c7605f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:b8:ab', 'vm-uuid': '1d9efe64-6660-40cb-8710-c262210b5f08'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:02 user nova-compute[73476]: INFO os_vif [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b8:ab,bridge_name='br-int',has_traffic_filtering=True,id=696cc9bf-5a5c-4771-b808-44d0b0c7605f,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696cc9bf-5a')
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No VIF found with MAC fa:16:3e:6f:b8:ab, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.network.neutron [req-ebca8038-6ee9-4d07-84eb-3e3898983fc9 req-bfced110-1797-4c8e-ba84-40ded7957528 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Updated VIF entry in instance network info cache for port 696cc9bf-5a5c-4771-b808-44d0b0c7605f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG nova.network.neutron [req-ebca8038-6ee9-4d07-84eb-3e3898983fc9 req-bfced110-1797-4c8e-ba84-40ded7957528 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Updating instance_info_cache with network_info: [{"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:05:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ebca8038-6ee9-4d07-84eb-3e3898983fc9 req-bfced110-1797-4c8e-ba84-40ded7957528 service nova] Releasing lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:05:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-8d04bb7d-ca1f-4295-ac63-ab02ed01d8e0 req-82e09954-8f9e-4047-a664-e750dec9d37a service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received event network-vif-plugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8d04bb7d-ca1f-4295-ac63-ab02ed01d8e0 req-82e09954-8f9e-4047-a664-e750dec9d37a service nova] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8d04bb7d-ca1f-4295-ac63-ab02ed01d8e0 req-82e09954-8f9e-4047-a664-e750dec9d37a service nova] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8d04bb7d-ca1f-4295-ac63-ab02ed01d8e0 req-82e09954-8f9e-4047-a664-e750dec9d37a service nova] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-8d04bb7d-ca1f-4295-ac63-ab02ed01d8e0 req-82e09954-8f9e-4047-a664-e750dec9d37a service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] No waiting events found dispatching network-vif-plugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:03 user nova-compute[73476]: WARNING nova.compute.manager [req-8d04bb7d-ca1f-4295-ac63-ab02ed01d8e0 req-82e09954-8f9e-4047-a664-e750dec9d37a service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received unexpected event network-vif-plugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f for instance with vm_state building and task_state spawning.
Aug 26 21:05:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:05 user nova-compute[73476]: INFO nova.compute.manager [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Unshelving
Aug 26 21:05:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG nova.objects.instance [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'pci_requests' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG nova.objects.instance [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'numa_topology' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:05:05 user nova-compute[73476]: INFO nova.compute.claims [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Claim successful on node user
Aug 26 21:05:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:05 user nova-compute[73476]: INFO nova.network.neutron [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating port 525b5d65-8ad1-445d-aa94-091fe68cbc0f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-01e9004c-ac31-4ce8-8eb7-d768be2a36f0 req-a094ddaa-3c7a-4a9e-bed5-22cb853dc53a service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received event network-vif-plugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-01e9004c-ac31-4ce8-8eb7-d768be2a36f0 req-a094ddaa-3c7a-4a9e-bed5-22cb853dc53a service nova] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-01e9004c-ac31-4ce8-8eb7-d768be2a36f0 req-a094ddaa-3c7a-4a9e-bed5-22cb853dc53a service nova] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-01e9004c-ac31-4ce8-8eb7-d768be2a36f0 req-a094ddaa-3c7a-4a9e-bed5-22cb853dc53a service nova] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-01e9004c-ac31-4ce8-8eb7-d768be2a36f0 req-a094ddaa-3c7a-4a9e-bed5-22cb853dc53a service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] No waiting events found dispatching network-vif-plugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:05 user nova-compute[73476]: WARNING nova.compute.manager [req-01e9004c-ac31-4ce8-8eb7-d768be2a36f0 req-a094ddaa-3c7a-4a9e-bed5-22cb853dc53a service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received unexpected event network-vif-plugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f for instance with vm_state building and task_state spawning.
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083906.1492782, 1d9efe64-6660-40cb-8710-c262210b5f08 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:05:06 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] VM Resumed (Lifecycle Event)
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Instance spawned successfully.
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:05:06 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083906.1509986, 1d9efe64-6660-40cb-8710-c262210b5f08 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:05:06 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] VM Started (Lifecycle Event)
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:05:06 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:05:06 user nova-compute[73476]: INFO nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Took 7.19 seconds to spawn the instance on the hypervisor.
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:06 user nova-compute[73476]: INFO nova.compute.manager [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Took 7.89 seconds to build instance.
Aug 26 21:05:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f4e2f531-6a54-4fd1-a808-731c62a97fc0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.988s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:05:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquired lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:05:06 user nova-compute[73476]: DEBUG nova.network.neutron [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG nova.network.neutron [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating instance_info_cache with network_info: [{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Releasing lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:05:07 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Creating image(s)
Aug 26 21:05:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG nova.objects.instance [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'trusted_certs' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG nova.objects.base [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<dadb69ec-5163-4e65-9656-3b80ee51fdf0> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "bdf546daba4c2281315a8099ed20d5cba629ae75" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "bdf546daba4c2281315a8099ed20d5cba629ae75" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75.part --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-fd8a61e7-e50a-433d-8c92-3ff27f5a354b req-e4cd1f0c-3f1c-40f9-bc10-01596f9d3325 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-changed-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-fd8a61e7-e50a-433d-8c92-3ff27f5a354b req-e4cd1f0c-3f1c-40f9-bc10-01596f9d3325 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Refreshing instance network info cache due to event network-changed-525b5d65-8ad1-445d-aa94-091fe68cbc0f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fd8a61e7-e50a-433d-8c92-3ff27f5a354b req-e4cd1f0c-3f1c-40f9-bc10-01596f9d3325 service nova] Acquiring lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fd8a61e7-e50a-433d-8c92-3ff27f5a354b req-e4cd1f0c-3f1c-40f9-bc10-01596f9d3325 service nova] Acquired lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG nova.network.neutron [req-fd8a61e7-e50a-433d-8c92-3ff27f5a354b req-e4cd1f0c-3f1c-40f9-bc10-01596f9d3325 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Refreshing network info cache for port 525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75.part --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG nova.virt.images [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] d54087c6-068a-4b93-80bd-3dc62a096f7d was qcow2, converting to raw {{(pid=73476) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG nova.privsep.utils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73476) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 21:05:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75.part /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75.converted {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG nova.network.neutron [req-fd8a61e7-e50a-433d-8c92-3ff27f5a354b req-e4cd1f0c-3f1c-40f9-bc10-01596f9d3325 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updated VIF entry in instance network info cache for port 525b5d65-8ad1-445d-aa94-091fe68cbc0f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG nova.network.neutron [req-fd8a61e7-e50a-433d-8c92-3ff27f5a354b req-e4cd1f0c-3f1c-40f9-bc10-01596f9d3325 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating instance_info_cache with network_info: [{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fd8a61e7-e50a-433d-8c92-3ff27f5a354b req-e4cd1f0c-3f1c-40f9-bc10-01596f9d3325 service nova] Releasing lock "refresh_cache-dadb69ec-5163-4e65-9656-3b80ee51fdf0" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75.part /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75.converted" returned: 0 in 0.515s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75.converted --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "bdf546daba4c2281315a8099ed20d5cba629ae75" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.900s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75 --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "bdf546daba4c2281315a8099ed20d5cba629ae75" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "bdf546daba4c2281315a8099ed20d5cba629ae75" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75 --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75,backing_fmt=raw /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75,backing_fmt=raw /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk 1073741824" returned: 0 in 0.049s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "bdf546daba4c2281315a8099ed20d5cba629ae75" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75 --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75 --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:10 user nova-compute[73476]: DEBUG nova.objects.instance [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'migration_context' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:10 user nova-compute[73476]: DEBUG nova.objects.base [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<dadb69ec-5163-4e65-9656-3b80ee51fdf0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Rebasing disk image.
Aug 26 21:05:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b -F raw /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b -F raw /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk" returned: 0 in 2.127s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Ensure instance console log exists: /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Start _get_guest_xml network_info=[{"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='36822ff1ec9378e3373977eba6c97bc7',container_format='bare',created_at=2023-08-26T21:03:12Z,direct_url=<?>,disk_format='qcow2',id=d54087c6-068a-4b93-80bd-3dc62a096f7d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-891897880-shelved',owner='69fdd3e8e61d47bd8a50affae1854448',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T21:03:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:05:12 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:05:12 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='36822ff1ec9378e3373977eba6c97bc7',container_format='bare',created_at=2023-08-26T21:03:12Z,direct_url=<?>,disk_format='qcow2',id=d54087c6-068a-4b93-80bd-3dc62a096f7d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-891897880-shelved',owner='69fdd3e8e61d47bd8a50affae1854448',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T21:03:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.objects.instance [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'vcpu_model' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.objects.base [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<dadb69ec-5163-4e65-9656-3b80ee51fdf0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-891897880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-891897880',id=37,image_ref='d54087c6-068a-4b93-80bd-3dc62a096f7d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1143520029',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-o05zd9bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member',shelved_at='2023-08-26T21:03:16.795308',shelved_host='user',shelved_image_id='d54087c6-068a-4b93-80bd-3dc62a096f7d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=dadb69ec-5163-4e65-9656-3b80ee51fdf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.objects.instance [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'pci_devices' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.objects.base [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Object Instance<dadb69ec-5163-4e65-9656-3b80ee51fdf0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:05:12 user nova-compute[73476]:   <uuid>dadb69ec-5163-4e65-9656-3b80ee51fdf0</uuid>
Aug 26 21:05:12 user nova-compute[73476]:   <name>instance-00000025</name>
Aug 26 21:05:12 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:05:12 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:05:12 user nova-compute[73476]:   <metadata>
Aug 26 21:05:12 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:05:12 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:05:12 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-891897880</nova:name>
Aug 26 21:05:12 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:05:12</nova:creationTime>
Aug 26 21:05:12 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:05:12 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:05:12 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:05:12 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:05:12 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:05:12 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:05:12 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:05:12 user nova-compute[73476]:       <nova:owner>
Aug 26 21:05:12 user nova-compute[73476]:         <nova:user uuid="23d582475c914098b5c6dce6268c2e2c">tempest-AttachVolumeShelveTestJSON-825342285-project-member</nova:user>
Aug 26 21:05:12 user nova-compute[73476]:         <nova:project uuid="69fdd3e8e61d47bd8a50affae1854448">tempest-AttachVolumeShelveTestJSON-825342285</nova:project>
Aug 26 21:05:12 user nova-compute[73476]:       </nova:owner>
Aug 26 21:05:12 user nova-compute[73476]:       <nova:root type="image" uuid="d54087c6-068a-4b93-80bd-3dc62a096f7d"/>
Aug 26 21:05:12 user nova-compute[73476]:       <nova:ports>
Aug 26 21:05:12 user nova-compute[73476]:         <nova:port uuid="525b5d65-8ad1-445d-aa94-091fe68cbc0f">
Aug 26 21:05:12 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 21:05:12 user nova-compute[73476]:         </nova:port>
Aug 26 21:05:12 user nova-compute[73476]:       </nova:ports>
Aug 26 21:05:12 user nova-compute[73476]:     </nova:instance>
Aug 26 21:05:12 user nova-compute[73476]:   </metadata>
Aug 26 21:05:12 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:05:12 user nova-compute[73476]:     <system>
Aug 26 21:05:12 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:05:12 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:05:12 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:05:12 user nova-compute[73476]:       <entry name="serial">dadb69ec-5163-4e65-9656-3b80ee51fdf0</entry>
Aug 26 21:05:12 user nova-compute[73476]:       <entry name="uuid">dadb69ec-5163-4e65-9656-3b80ee51fdf0</entry>
Aug 26 21:05:12 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:05:12 user nova-compute[73476]:     </system>
Aug 26 21:05:12 user nova-compute[73476]:   </sysinfo>
Aug 26 21:05:12 user nova-compute[73476]:   <os>
Aug 26 21:05:12 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:05:12 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:05:12 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:05:12 user nova-compute[73476]:   </os>
Aug 26 21:05:12 user nova-compute[73476]:   <features>
Aug 26 21:05:12 user nova-compute[73476]:     <acpi/>
Aug 26 21:05:12 user nova-compute[73476]:     <apic/>
Aug 26 21:05:12 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:05:12 user nova-compute[73476]:   </features>
Aug 26 21:05:12 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:05:12 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:05:12 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:05:12 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:05:12 user nova-compute[73476]:   </clock>
Aug 26 21:05:12 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:05:12 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:05:12 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:05:12 user nova-compute[73476]:   </cpu>
Aug 26 21:05:12 user nova-compute[73476]:   <devices>
Aug 26 21:05:12 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:05:12 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:05:12 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk"/>
Aug 26 21:05:12 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:05:12 user nova-compute[73476]:     </disk>
Aug 26 21:05:12 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:05:12 user nova-compute[73476]:       <mac address="fa:16:3e:7e:b1:ed"/>
Aug 26 21:05:12 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:05:12 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:05:12 user nova-compute[73476]:       <target dev="tap525b5d65-8a"/>
Aug 26 21:05:12 user nova-compute[73476]:     </interface>
Aug 26 21:05:12 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:05:12 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/console.log" append="off"/>
Aug 26 21:05:12 user nova-compute[73476]:     </serial>
Aug 26 21:05:12 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:05:12 user nova-compute[73476]:     <video>
Aug 26 21:05:12 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:05:12 user nova-compute[73476]:     </video>
Aug 26 21:05:12 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:05:12 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:05:12 user nova-compute[73476]:     </rng>
Aug 26 21:05:12 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:05:12 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:05:12 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:05:12 user nova-compute[73476]:     </memballoon>
Aug 26 21:05:12 user nova-compute[73476]:   </devices>
Aug 26 21:05:12 user nova-compute[73476]: </domain>
Aug 26 21:05:12 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-891897880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-891897880',id=37,image_ref='d54087c6-068a-4b93-80bd-3dc62a096f7d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1143520029',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-o05zd9bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member',shelved_at='2023-08-26T21:03:16.795308',shelved_host='user',shelved_image_id='d54087c6-068a-4b93-80bd-3dc62a096f7d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=dadb69ec-5163-4e65-9656-3b80ee51fdf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG os_vif [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525b5d65-8a, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap525b5d65-8a, col_values=(('external_ids', {'iface-id': '525b5d65-8ad1-445d-aa94-091fe68cbc0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b1:ed', 'vm-uuid': 'dadb69ec-5163-4e65-9656-3b80ee51fdf0'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:12 user nova-compute[73476]: INFO os_vif [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a')
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:05:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] No VIF found with MAC fa:16:3e:7e:b1:ed, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:05:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-e183b844-f3e7-4576-a5e8-5121d0b0f8d8 req-7dab6ab3-60c8-4337-94cf-50db52533c70 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e183b844-f3e7-4576-a5e8-5121d0b0f8d8 req-7dab6ab3-60c8-4337-94cf-50db52533c70 service nova] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e183b844-f3e7-4576-a5e8-5121d0b0f8d8 req-7dab6ab3-60c8-4337-94cf-50db52533c70 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e183b844-f3e7-4576-a5e8-5121d0b0f8d8 req-7dab6ab3-60c8-4337-94cf-50db52533c70 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-e183b844-f3e7-4576-a5e8-5121d0b0f8d8 req-7dab6ab3-60c8-4337-94cf-50db52533c70 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] No waiting events found dispatching network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:14 user nova-compute[73476]: WARNING nova.compute.manager [req-e183b844-f3e7-4576-a5e8-5121d0b0f8d8 req-7dab6ab3-60c8-4337-94cf-50db52533c70 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received unexpected event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 21:05:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083916.041831, dadb69ec-5163-4e65-9656-3b80ee51fdf0 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:05:16 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] VM Resumed (Lifecycle Event)
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:05:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance spawned successfully.
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:05:16 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083916.041965, dadb69ec-5163-4e65-9656-3b80ee51fdf0 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:05:16 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] VM Started (Lifecycle Event)
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:05:16 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-dde3e8ed-7865-4f01-851d-32f5df9266e0 req-e3e46a5e-20e3-4598-b6b1-a1027b466215 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dde3e8ed-7865-4f01-851d-32f5df9266e0 req-e3e46a5e-20e3-4598-b6b1-a1027b466215 service nova] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dde3e8ed-7865-4f01-851d-32f5df9266e0 req-e3e46a5e-20e3-4598-b6b1-a1027b466215 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-dde3e8ed-7865-4f01-851d-32f5df9266e0 req-e3e46a5e-20e3-4598-b6b1-a1027b466215 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-dde3e8ed-7865-4f01-851d-32f5df9266e0 req-e3e46a5e-20e3-4598-b6b1-a1027b466215 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] No waiting events found dispatching network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:16 user nova-compute[73476]: WARNING nova.compute.manager [req-dde3e8ed-7865-4f01-851d-32f5df9266e0 req-e3e46a5e-20e3-4598-b6b1-a1027b466215 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received unexpected event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 21:05:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-320c78c9-4aa4-47c8-8cc1-b2953d478f1a tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.022s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "f3ab142f-91a1-45d5-a133-f922d782ac8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:36 user nova-compute[73476]: INFO nova.compute.manager [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Terminating instance
Aug 26 21:05:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG nova.compute.manager [req-fb1d4a40-e650-4d85-aa4b-10deda558ac0 req-3e33e5f9-eef9-45a3-b3dd-26dd4d2b88d0 service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received event network-vif-unplugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fb1d4a40-e650-4d85-aa4b-10deda558ac0 req-3e33e5f9-eef9-45a3-b3dd-26dd4d2b88d0 service nova] Acquiring lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fb1d4a40-e650-4d85-aa4b-10deda558ac0 req-3e33e5f9-eef9-45a3-b3dd-26dd4d2b88d0 service nova] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fb1d4a40-e650-4d85-aa4b-10deda558ac0 req-3e33e5f9-eef9-45a3-b3dd-26dd4d2b88d0 service nova] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG nova.compute.manager [req-fb1d4a40-e650-4d85-aa4b-10deda558ac0 req-3e33e5f9-eef9-45a3-b3dd-26dd4d2b88d0 service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] No waiting events found dispatching network-vif-unplugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:36 user nova-compute[73476]: DEBUG nova.compute.manager [req-fb1d4a40-e650-4d85-aa4b-10deda558ac0 req-3e33e5f9-eef9-45a3-b3dd-26dd4d2b88d0 service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received event network-vif-unplugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:05:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Instance destroyed successfully.
Aug 26 21:05:37 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'resources' on Instance uuid f3ab142f-91a1-45d5-a133-f922d782ac8c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1101542102',display_name='tempest-TestVolumeBootPattern-server-1101542102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1101542102',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-j2dbpxhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:04:08Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=f3ab142f-91a1-45d5-a133-f922d782ac8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "address": "fa:16:3e:9d:25:be", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a3ba5e-66", "ovs_interfaceid": "69a3ba5e-663b-4d88-a9b3-fd92a1502a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:be,bridge_name='br-int',has_traffic_filtering=True,id=69a3ba5e-663b-4d88-a9b3-fd92a1502a49,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a3ba5e-66') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_vif [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:be,bridge_name='br-int',has_traffic_filtering=True,id=69a3ba5e-663b-4d88-a9b3-fd92a1502a49,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a3ba5e-66') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69a3ba5e-66, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:37 user nova-compute[73476]: INFO os_vif [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:25:be,bridge_name='br-int',has_traffic_filtering=True,id=69a3ba5e-663b-4d88-a9b3-fd92a1502a49,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a3ba5e-66')
Aug 26 21:05:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkWmKPVg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:05:37 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[554e3086-a4f6-4cde-b4f1-1730ac227c70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b96286-f300-4d86-a5fd-ee5062c5fb84]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:37 user nova-compute[73476]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)
Aug 26 21:05:37 user nova-compute[73476]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:37 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:37 user nova-compute[73476]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be (non-flash)
Aug 26 21:05:37 user nova-compute[73476]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:37 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25dfd19360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[763acb72-e14c-4270-ba98-e2400f519655]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd59e0f-0ddf-435e-8014-0488d7f5868d]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc15ba3-27c7-425a-80d5-7ed1e4e31461]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdebac97-8e7d-4342-962c-a81858bb59cf]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3016b8d4-73a3-4e53-9687-a73b8ffba6e3]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae9b6c7-9490-41d9-adbb-179bde971972]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be, portal: 172.16.0.220,3260]
Aug 26 21:05:37 user nova-compute[73476]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be, portal: 172.16.0.220,3260] successful.
Aug 26 21:05:37 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3d1d77-9e12-421b-80ac-df8bb99d46be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afb54ed-01b5-42b3-918e-7f38bb3b6e62]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== disconnect_volume: return (287ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:05:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Deleting instance files /opt/stack/data/nova/instances/f3ab142f-91a1-45d5-a133-f922d782ac8c_del
Aug 26 21:05:37 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Deletion of /opt/stack/data/nova/instances/f3ab142f-91a1-45d5-a133-f922d782ac8c_del complete
Aug 26 21:05:37 user nova-compute[73476]: INFO nova.compute.manager [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 21:05:37 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:05:37 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:05:38 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:05:38 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Took 0.68 seconds to deallocate network for instance.
Aug 26 21:05:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-7d53303f-325b-4aaf-895a-466d91a261cb req-6b3d2a30-eef5-4f01-b14d-e7bc389b017e service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received event network-vif-plugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7d53303f-325b-4aaf-895a-466d91a261cb req-6b3d2a30-eef5-4f01-b14d-e7bc389b017e service nova] Acquiring lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7d53303f-325b-4aaf-895a-466d91a261cb req-6b3d2a30-eef5-4f01-b14d-e7bc389b017e service nova] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7d53303f-325b-4aaf-895a-466d91a261cb req-6b3d2a30-eef5-4f01-b14d-e7bc389b017e service nova] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-7d53303f-325b-4aaf-895a-466d91a261cb req-6b3d2a30-eef5-4f01-b14d-e7bc389b017e service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] No waiting events found dispatching network-vif-plugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:38 user nova-compute[73476]: WARNING nova.compute.manager [req-7d53303f-325b-4aaf-895a-466d91a261cb req-6b3d2a30-eef5-4f01-b14d-e7bc389b017e service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received unexpected event network-vif-plugged-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 for instance with vm_state active and task_state deleting.
Aug 26 21:05:38 user nova-compute[73476]: DEBUG nova.compute.manager [req-7d53303f-325b-4aaf-895a-466d91a261cb req-6b3d2a30-eef5-4f01-b14d-e7bc389b017e service nova] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Received event network-vif-deleted-69a3ba5e-663b-4d88-a9b3-fd92a1502a49 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:39 user nova-compute[73476]: INFO nova.compute.manager [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Took 0.76 seconds to detach 1 volumes for instance.
Aug 26 21:05:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Deleting volume: 7f3d1d77-9e12-421b-80ac-df8bb99d46be {{(pid=73476) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:39 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Deleted allocations for instance f3ab142f-91a1-45d5-a133-f922d782ac8c
Aug 26 21:05:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63ff0c9a-5ddf-4a18-8490-086f29702bf6 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "f3ab142f-91a1-45d5-a133-f922d782ac8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.113s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquired lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'info_cache' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:39 user nova-compute[73476]: DEBUG nova.objects.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating instance_info_cache with network_info: [{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Releasing lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:05:40 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance destroyed successfully.
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'resources' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.objects.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-688110644',display_name='tempest-AttachVolumeTestJSON-server-688110644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-688110644',id=38,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9LlIp4XneY32xtVLh6cIt5TSoHUqkcuD1XQ4hBSRMkm9So7JHOZP6BIojHT3q3aZ2oMpkm94dx8SqLtMc8f3ohUAvHCObRUe+gUe4wm/9E3dxtRL6BXFbzsvtqoJlbAw==',key_name='tempest-keypair-1294012772',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-uhly31gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=7d07fece-58a4-46ec-902c-f1506956d1fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_vif [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64288b3e-9d, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:05:40 user nova-compute[73476]: INFO os_vif [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d')
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzDMoRha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:05:40 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c5aea6-229c-4d52-8b26-29bd4bd6ed73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a109dc-6908-4f11-8815-0fa416787a8e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:40 user nova-compute[73476]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:40 user nova-compute[73476]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b02b6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1561837f-b398-40d5-a1af-9686369c6764]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3596c31f-c5fb-40bf-9232-34acef9499ee]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19c3860-15ee-4b5a-a47e-51bc11ae28cf]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[501a75d5-0753-4e3b-a867-204a923cc7d4]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145a154-d4aa-4e37-97f9-87ee7de9f8e2]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c646c3-1b6c-4d5f-baa3-ac606b8b6011]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260]
Aug 26 21:05:40 user nova-compute[73476]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260] successful.
Aug 26 21:05:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89049e6-41cd-4aa2-a8bf-4e6982d58d7b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== disconnect_volume: return (278ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Start _get_guest_xml network_info=[{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'ddfec89e-ace4-4390-a6e5-d1a68c99baa3', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzDMoRha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7d07fece-58a4-46ec-902c-f1506956d1fa', 'attached_at': '', 'detached_at': '', 'volume_id': '8e0751f6-3f51-43e0-a361-09a663650561', 'serial': '8e0751f6-3f51-43e0-a361-09a663650561'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.objects.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:40 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:05:40 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.objects.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzDMoRha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:05:40 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:05:40 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:05:40 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c253f51-24c7-4708-b4ef-025bc574ef1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:05:40 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[da997d4a-20ca-4ada-8ecf-014369f42d3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561] added
Aug 26 21:05:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98d392f-18de-46d5-afb4-ef31482e8888]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7010e7-6d29-462f-a55b-831dd25201d1]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzDMoRha {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzDMoRha" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabc9121-ad1a-4103-b976-d1cb1f2fc88d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IzDMoRha'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59acc17-03d2-472b-9d7a-0b66b0f1f35a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f66068d-3329-443f-8db6-65cfcea058f3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:40 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:05:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[83adf3aa-ae06-4b88-9818-5f88893f7957]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260]
Aug 26 21:05:41 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260] successful.
Aug 26 21:05:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[24607e9b-a556-4626-8a3c-e33b96b25335]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba14edd0-a42e-4035-a86f-59d9bb9eb2b5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:41 user nova-compute[73476]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:41 user nova-compute[73476]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f5149c-6483-422a-9e5d-600affd2e1ba]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzDMoRha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:05:41 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23963326335633132', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963326335633132', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-688110644',display_name='tempest-AttachVolumeTestJSON-server-688110644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-688110644',id=38,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9LlIp4XneY32xtVLh6cIt5TSoHUqkcuD1XQ4hBSRMkm9So7JHOZP6BIojHT3q3aZ2oMpkm94dx8SqLtMc8f3ohUAvHCObRUe+gUe4wm/9E3dxtRL6BXFbzsvtqoJlbAw==',key_name='tempest-keypair-1294012772',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-uhly31gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=7d07fece-58a4-46ec-902c-f1506956d1fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.objects.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:05:42 user nova-compute[73476]:   <uuid>7d07fece-58a4-46ec-902c-f1506956d1fa</uuid>
Aug 26 21:05:42 user nova-compute[73476]:   <name>instance-00000026</name>
Aug 26 21:05:42 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:05:42 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:05:42 user nova-compute[73476]:   <metadata>
Aug 26 21:05:42 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:05:42 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:05:42 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeTestJSON-server-688110644</nova:name>
Aug 26 21:05:42 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:05:40</nova:creationTime>
Aug 26 21:05:42 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:05:42 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:05:42 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:05:42 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:05:42 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:05:42 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:05:42 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:05:42 user nova-compute[73476]:       <nova:owner>
Aug 26 21:05:42 user nova-compute[73476]:         <nova:user uuid="4d2ff94872bd43dd8f7e4319e9e63934">tempest-AttachVolumeTestJSON-359578438-project-member</nova:user>
Aug 26 21:05:42 user nova-compute[73476]:         <nova:project uuid="3ed24e21a3624f4e8a4311728ff1c9f5">tempest-AttachVolumeTestJSON-359578438</nova:project>
Aug 26 21:05:42 user nova-compute[73476]:       </nova:owner>
Aug 26 21:05:42 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:05:42 user nova-compute[73476]:       <nova:ports>
Aug 26 21:05:42 user nova-compute[73476]:         <nova:port uuid="64288b3e-9d2a-4c14-9a96-308182a1bf4b">
Aug 26 21:05:42 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 21:05:42 user nova-compute[73476]:         </nova:port>
Aug 26 21:05:42 user nova-compute[73476]:       </nova:ports>
Aug 26 21:05:42 user nova-compute[73476]:     </nova:instance>
Aug 26 21:05:42 user nova-compute[73476]:   </metadata>
Aug 26 21:05:42 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:05:42 user nova-compute[73476]:     <system>
Aug 26 21:05:42 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:05:42 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:05:42 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:05:42 user nova-compute[73476]:       <entry name="serial">7d07fece-58a4-46ec-902c-f1506956d1fa</entry>
Aug 26 21:05:42 user nova-compute[73476]:       <entry name="uuid">7d07fece-58a4-46ec-902c-f1506956d1fa</entry>
Aug 26 21:05:42 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:05:42 user nova-compute[73476]:     </system>
Aug 26 21:05:42 user nova-compute[73476]:   </sysinfo>
Aug 26 21:05:42 user nova-compute[73476]:   <os>
Aug 26 21:05:42 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:05:42 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:05:42 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:05:42 user nova-compute[73476]:   </os>
Aug 26 21:05:42 user nova-compute[73476]:   <features>
Aug 26 21:05:42 user nova-compute[73476]:     <acpi/>
Aug 26 21:05:42 user nova-compute[73476]:     <apic/>
Aug 26 21:05:42 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:05:42 user nova-compute[73476]:   </features>
Aug 26 21:05:42 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:05:42 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:05:42 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:05:42 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:05:42 user nova-compute[73476]:   </clock>
Aug 26 21:05:42 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:05:42 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:05:42 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:05:42 user nova-compute[73476]:   </cpu>
Aug 26 21:05:42 user nova-compute[73476]:   <devices>
Aug 26 21:05:42 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:05:42 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:05:42 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk"/>
Aug 26 21:05:42 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:05:42 user nova-compute[73476]:     </disk>
Aug 26 21:05:42 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 21:05:42 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:05:42 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 21:05:42 user nova-compute[73476]:       <target dev="vdb" bus="virtio"/>
Aug 26 21:05:42 user nova-compute[73476]:       <serial>8e0751f6-3f51-43e0-a361-09a663650561</serial>
Aug 26 21:05:42 user nova-compute[73476]:     </disk>
Aug 26 21:05:42 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:05:42 user nova-compute[73476]:       <mac address="fa:16:3e:40:fb:89"/>
Aug 26 21:05:42 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:05:42 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:05:42 user nova-compute[73476]:       <target dev="tap64288b3e-9d"/>
Aug 26 21:05:42 user nova-compute[73476]:     </interface>
Aug 26 21:05:42 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:05:42 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/console.log" append="off"/>
Aug 26 21:05:42 user nova-compute[73476]:     </serial>
Aug 26 21:05:42 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:05:42 user nova-compute[73476]:     <video>
Aug 26 21:05:42 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:05:42 user nova-compute[73476]:     </video>
Aug 26 21:05:42 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:05:42 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:05:42 user nova-compute[73476]:     </rng>
Aug 26 21:05:42 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:05:42 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:05:42 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:05:42 user nova-compute[73476]:     </memballoon>
Aug 26 21:05:42 user nova-compute[73476]:   </devices>
Aug 26 21:05:42 user nova-compute[73476]: </domain>
Aug 26 21:05:42 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.objects.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Cannot resize image /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'migration_context' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.objects.base [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-688110644',display_name='tempest-AttachVolumeTestJSON-server-688110644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-688110644',id=38,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9LlIp4XneY32xtVLh6cIt5TSoHUqkcuD1XQ4hBSRMkm9So7JHOZP6BIojHT3q3aZ2oMpkm94dx8SqLtMc8f3ohUAvHCObRUe+gUe4wm/9E3dxtRL6BXFbzsvtqoJlbAw==',key_name='tempest-keypair-1294012772',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-uhly31gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=7d07fece-58a4-46ec-902c-f1506956d1fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG os_vif [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:05:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64288b3e-9d, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64288b3e-9d, col_values=(('external_ids', {'iface-id': '64288b3e-9d2a-4c14-9a96-308182a1bf4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:fb:89', 'vm-uuid': '7d07fece-58a4-46ec-902c-f1506956d1fa'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:05:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:43 user nova-compute[73476]: INFO os_vif [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d')
Aug 26 21:05:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:44 user nova-compute[73476]: DEBUG nova.compute.manager [req-8478ce9f-950a-46b2-88fd-eb78d45da463 req-cf09ff56-5198-4ea7-a325-409fce4b7e95 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8478ce9f-950a-46b2-88fd-eb78d45da463 req-cf09ff56-5198-4ea7-a325-409fce4b7e95 service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8478ce9f-950a-46b2-88fd-eb78d45da463 req-cf09ff56-5198-4ea7-a325-409fce4b7e95 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8478ce9f-950a-46b2-88fd-eb78d45da463 req-cf09ff56-5198-4ea7-a325-409fce4b7e95 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:44 user nova-compute[73476]: DEBUG nova.compute.manager [req-8478ce9f-950a-46b2-88fd-eb78d45da463 req-cf09ff56-5198-4ea7-a325-409fce4b7e95 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:44 user nova-compute[73476]: WARNING nova.compute.manager [req-8478ce9f-950a-46b2-88fd-eb78d45da463 req-cf09ff56-5198-4ea7-a325-409fce4b7e95 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state stopped and task_state powering-on.
Aug 26 21:05:44 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:44 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083946.5985677, 7d07fece-58a4-46ec-902c-f1506956d1fa => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:05:46 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] VM Resumed (Lifecycle Event)
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:05:46 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance rebooted successfully.
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f09122ca-8488-4abc-bcd0-ac5a73ca8218 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:05:46 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693083946.6003542, 7d07fece-58a4-46ec-902c-f1506956d1fa => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:05:46 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] VM Started (Lifecycle Event)
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-e845963c-020a-4dcd-817c-c9ecbe8819cf req-6b225d79-7507-4419-9724-606c6d3347cf service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e845963c-020a-4dcd-817c-c9ecbe8819cf req-6b225d79-7507-4419-9724-606c6d3347cf service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e845963c-020a-4dcd-817c-c9ecbe8819cf req-6b225d79-7507-4419-9724-606c6d3347cf service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e845963c-020a-4dcd-817c-c9ecbe8819cf req-6b225d79-7507-4419-9724-606c6d3347cf service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-e845963c-020a-4dcd-817c-c9ecbe8819cf req-6b225d79-7507-4419-9724-606c6d3347cf service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:46 user nova-compute[73476]: WARNING nova.compute.manager [req-e845963c-020a-4dcd-817c-c9ecbe8819cf req-6b225d79-7507-4419-9724-606c6d3347cf service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state active and task_state None.
Aug 26 21:05:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:50 user nova-compute[73476]: INFO nova.compute.manager [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Detaching volume 20774b19-0803-472d-b055-283ae309d2c4
Aug 26 21:05:50 user nova-compute[73476]: INFO nova.virt.block_device [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Attempting to driver detach volume 20774b19-0803-472d-b055-283ae309d2c4 from mountpoint /dev/vdb
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Attempting to detach device vdb from instance b699d711-cfff-4095-a9fe-e6ad1bad94eb from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:05:50 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:05:50 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 21:05:50 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:05:50 user nova-compute[73476]:   <serial>20774b19-0803-472d-b055-283ae309d2c4</serial>
Aug 26 21:05:50 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:05:50 user nova-compute[73476]: </disk>
Aug 26 21:05:50 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:05:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Successfully detached device vdb from instance b699d711-cfff-4095-a9fe-e6ad1bad94eb from the persistent domain config.
Aug 26 21:05:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b699d711-cfff-4095-a9fe-e6ad1bad94eb from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:05:50 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:05:50 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 21:05:50 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:05:50 user nova-compute[73476]:   <serial>20774b19-0803-472d-b055-283ae309d2c4</serial>
Aug 26 21:05:50 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:05:50 user nova-compute[73476]: </disk>
Aug 26 21:05:50 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693083950.7463427, b699d711-cfff-4095-a9fe-e6ad1bad94eb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b699d711-cfff-4095-a9fe-e6ad1bad94eb {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:05:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Successfully detached device vdb from instance b699d711-cfff-4095-a9fe-e6ad1bad94eb from the live domain config.
Aug 26 21:05:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnVQSuhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:05:50 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ee6422-63b7-4074-9875-fd530b537e23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29e7723-5912-4616-978e-042c6a2faa80]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:50 user nova-compute[73476]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 (non-flash)
Aug 26 21:05:50 user nova-compute[73476]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b0124dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4'): ({'sdd'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Removing single pathed devices sdd {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aa940c-c741-42c0-bc28-f2e2bed11499]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d01c195-f44d-46bd-9b11-3f13a863cab6]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Flushing IO for device /dev/sdd {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87d371a-d3ad-4276-9919-ecdcb89478ad]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0950dda5-6dad-4ce4-b6db-e0ff4c1536b4]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:05:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfdafb5-c09a-4e4c-9738-933bf122c1f6]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[774cfec5-9859-4762-aae3-57ad2c4188a7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4, portal: 172.16.0.220,3260]
Aug 26 21:05:51 user nova-compute[73476]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4, portal: 172.16.0.220,3260] successful.
Aug 26 21:05:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf330724-6dbe-4c31-93d3-3d5f877ef8b3]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] <== disconnect_volume: return (378ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'flavor' on Instance uuid b699d711-cfff-4095-a9fe-e6ad1bad94eb {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9d5bd37f-e223-45f9-bcbc-99dfa91b9608 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.990s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.869s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:52 user nova-compute[73476]: INFO nova.compute.manager [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Terminating instance
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083937.237383, f3ab142f-91a1-45d5-a133-f922d782ac8c => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:05:52 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] VM Stopped (Lifecycle Event)
Aug 26 21:05:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f45e7683-8f4b-457e-bed6-cc3f71ab441e None None] [instance: f3ab142f-91a1-45d5-a133-f922d782ac8c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-4424bdbf-e3e9-4298-9b43-0f9bb81a683a req-7b3ed755-cc74-487d-969c-b062eee44f6b service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received event network-vif-unplugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4424bdbf-e3e9-4298-9b43-0f9bb81a683a req-7b3ed755-cc74-487d-969c-b062eee44f6b service nova] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4424bdbf-e3e9-4298-9b43-0f9bb81a683a req-7b3ed755-cc74-487d-969c-b062eee44f6b service nova] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4424bdbf-e3e9-4298-9b43-0f9bb81a683a req-7b3ed755-cc74-487d-969c-b062eee44f6b service nova] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-4424bdbf-e3e9-4298-9b43-0f9bb81a683a req-7b3ed755-cc74-487d-969c-b062eee44f6b service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] No waiting events found dispatching network-vif-unplugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-4424bdbf-e3e9-4298-9b43-0f9bb81a683a req-7b3ed755-cc74-487d-969c-b062eee44f6b service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received event network-vif-unplugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:52 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Instance destroyed successfully.
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'resources' on Instance uuid b699d711-cfff-4095-a9fe-e6ad1bad94eb {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1692837612',display_name='tempest-VolumesSnapshotTestJSON-instance-1692837612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1692837612',id=41,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1O1pcUSRPBrB9k8V8jFhm3EEqHgZCVqbJqbJDVJ3A7pTRO+M2AYwKU24pu8tv6Ww3meaKnOkAoi6Y/h+n84OpG50mjYdXDPmpVD/BFhCfuSocFwafv0uY0AxJvvqWVaA==',key_name='tempest-keypair-978889703',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:03:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b84b4dda8794d89a3b826169d3622ae',ramdisk_id='',reservation_id='r-192ipznn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1103521950',owner_user_name='tempest-VolumesSnapshotTestJSON-1103521950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:03:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9fdaeb7bcc6482e87bb4b9757c5ff94',uuid=b699d711-cfff-4095-a9fe-e6ad1bad94eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converting VIF {"id": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "address": "fa:16:3e:2b:26:f2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b18763-d8", "ovs_interfaceid": "c3b18763-d863-4a04-879e-1de60aa7e6a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3b18763-d863-4a04-879e-1de60aa7e6a0,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b18763-d8') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG os_vif [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3b18763-d863-4a04-879e-1de60aa7e6a0,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b18763-d8') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3b18763-d8, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:05:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:52 user nova-compute[73476]: INFO os_vif [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3b18763-d863-4a04-879e-1de60aa7e6a0,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b18763-d8')
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnVQSuhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:05:53 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20774b19-0803-472d-b055-283ae309d2c4', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2610bc9-29cf-4a81-b47d-4c8503e280ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f4122b-9085-4c97-b6ae-1eba22f6a787]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:53 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:05:53 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b063bac0>, {}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Disconnecting from: [] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] <== disconnect_volume: return (50ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:05:53 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Deleting instance files /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb_del
Aug 26 21:05:53 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Deletion of /opt/stack/data/nova/instances/b699d711-cfff-4095-a9fe-e6ad1bad94eb_del complete
Aug 26 21:05:53 user nova-compute[73476]: INFO nova.compute.manager [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:05:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:05:53 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8020MB free_disk=24.98193359375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3639bd9f-308c-4680-b18c-0720d6f18327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance b699d711-cfff-4095-a9fe-e6ad1bad94eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1d9efe64-6660-40cb-8710-c262210b5f08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance dadb69ec-5163-4e65-9656-3b80ee51fdf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:05:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:05:54 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Took 1.37 seconds to deallocate network for instance.
Aug 26 21:05:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-30036886-04a1-47bf-9cf1-33df49d815c5 req-bf28e293-83aa-4696-983e-acf38a93d773 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received event network-vif-plugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-30036886-04a1-47bf-9cf1-33df49d815c5 req-bf28e293-83aa-4696-983e-acf38a93d773 service nova] Acquiring lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-30036886-04a1-47bf-9cf1-33df49d815c5 req-bf28e293-83aa-4696-983e-acf38a93d773 service nova] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-30036886-04a1-47bf-9cf1-33df49d815c5 req-bf28e293-83aa-4696-983e-acf38a93d773 service nova] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-30036886-04a1-47bf-9cf1-33df49d815c5 req-bf28e293-83aa-4696-983e-acf38a93d773 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] No waiting events found dispatching network-vif-plugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:05:54 user nova-compute[73476]: WARNING nova.compute.manager [req-30036886-04a1-47bf-9cf1-33df49d815c5 req-bf28e293-83aa-4696-983e-acf38a93d773 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received unexpected event network-vif-plugged-c3b18763-d863-4a04-879e-1de60aa7e6a0 for instance with vm_state active and task_state deleting.
Aug 26 21:05:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-30036886-04a1-47bf-9cf1-33df49d815c5 req-bf28e293-83aa-4696-983e-acf38a93d773 service nova] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Received event network-vif-deleted-c3b18763-d863-4a04-879e-1de60aa7e6a0 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:05:54 user nova-compute[73476]: WARNING nova.volume.cinder [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Attachment 7e76e1e2-64a7-4581-a6fb-e106b83e4f09 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7e76e1e2-64a7-4581-a6fb-e106b83e4f09. (HTTP 404) (Request-ID: req-e6c634e5-4e69-4c60-a1b9-ed362399363e)
Aug 26 21:05:54 user nova-compute[73476]: INFO nova.compute.manager [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Took 0.03 seconds to detach 1 volumes for instance.
Aug 26 21:05:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:05:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:54 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Deleted allocations for instance b699d711-cfff-4095-a9fe-e6ad1bad94eb
Aug 26 21:05:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-89805757-c920-41e9-99e9-d2d6f82ab13f tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "b699d711-cfff-4095-a9fe-e6ad1bad94eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.781s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:05:55 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:05:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:05:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:05:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:05:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating instance_info_cache with network_info: [{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:05:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:05:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:05:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:05:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:07 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693083952.8963914, b699d711-cfff-4095-a9fe-e6ad1bad94eb => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:06:07 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] VM Stopped (Lifecycle Event)
Aug 26 21:06:07 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9689e6dd-3c12-4586-8328-aed6aef531af None None] [instance: b699d711-cfff-4095-a9fe-e6ad1bad94eb] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:06:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:06:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:06:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:06:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:06:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:06:39 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:06:39 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:06:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:43 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:06:44 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:06:45 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:06:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:06:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG nova.compute.manager [req-74958757-86f3-4709-b34b-75fc9bbce923 req-b9e29c6f-2de0-4261-9acb-1816187dae9f service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received event network-changed-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG nova.compute.manager [req-74958757-86f3-4709-b34b-75fc9bbce923 req-b9e29c6f-2de0-4261-9acb-1816187dae9f service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Refreshing instance network info cache due to event network-changed-696cc9bf-5a5c-4771-b808-44d0b0c7605f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-74958757-86f3-4709-b34b-75fc9bbce923 req-b9e29c6f-2de0-4261-9acb-1816187dae9f service nova] Acquiring lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-74958757-86f3-4709-b34b-75fc9bbce923 req-b9e29c6f-2de0-4261-9acb-1816187dae9f service nova] Acquired lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-74958757-86f3-4709-b34b-75fc9bbce923 req-b9e29c6f-2de0-4261-9acb-1816187dae9f service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Refreshing network info cache for port 696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:06:51 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'flavor' on Instance uuid 1d9efe64-6660-40cb-8710-c262210b5f08 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:52 user nova-compute[73476]: INFO nova.compute.manager [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Attaching volume 1274e0e7-b358-44f7-92c4-85754d2f79aa to /dev/vdb
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "a106a9ab-407a-49b1-99fd-6406b89e065c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG os_brick.utils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5783a2f-0322-41ea-bfb4-2aca67ab2198]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ebdcec-ab3e-4208-88e6-efb9a2bbaa98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:06:52 user nova-compute[73476]: INFO nova.compute.claims [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Claim successful on node user
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb82690-2b58-46d4-8055-b896f1a3fe67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[450fb73c-e2ea-4289-8e17-4ab2b647fb4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:06:52 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84999aa-2431-4319-b34c-817f88285ed7]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG os_brick.utils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Updating existing volume attachment record: 76b5d28a-53dd-48fb-8cb2-30316623b5ec {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG nova.network.neutron [req-74958757-86f3-4709-b34b-75fc9bbce923 req-b9e29c6f-2de0-4261-9acb-1816187dae9f service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Updated VIF entry in instance network info cache for port 696cc9bf-5a5c-4771-b808-44d0b0c7605f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG nova.network.neutron [req-74958757-86f3-4709-b34b-75fc9bbce923 req-b9e29c6f-2de0-4261-9acb-1816187dae9f service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Updating instance_info_cache with network_info: [{"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-74958757-86f3-4709-b34b-75fc9bbce923 req-b9e29c6f-2de0-4261-9acb-1816187dae9f service nova] Releasing lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:06:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updating instance_info_cache with network_info: [{"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.137s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:06:53 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.policy [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bb1fc1180d34eb0ae98c52187aae87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1962b32d78d4f6da29bb0fdaa001363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:06:53 user nova-compute[73476]: INFO nova.virt.block_device [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Booting with volume e5bb0c52-e50e-4105-8056-d750ce6bab6c at /dev/vda
Aug 26 21:06:53 user nova-compute[73476]: DEBUG os_brick.utils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50e5e91-020b-4aad-80ef-162b09b64e4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c2af5-08b9-4bb9-8dd5-045fbe536fd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bced1b-c192-4908-b30e-d19404ffeaeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[940213c2-327d-4338-9a17-62a4e8b61798]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:06:53 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7898351-6ab5-4aba-82b2-1f4a709cd4c1]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG os_brick.utils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updating existing volume attachment record: 4bbacfa2-6947-4bf6-946e-faa605a50239 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Successfully created port: fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Successfully updated port: fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquired lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-9d95a0e6-4b33-451a-acc6-0f21cad3911d req-777f4978-cf40-43f1-a9e8-053d885cc056 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received event network-changed-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG nova.compute.manager [req-9d95a0e6-4b33-451a-acc6-0f21cad3911d req-777f4978-cf40-43f1-a9e8-053d885cc056 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Refreshing instance network info cache due to event network-changed-fd56409a-6505-48f2-95d2-8d0162ad28af. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9d95a0e6-4b33-451a-acc6-0f21cad3911d req-777f4978-cf40-43f1-a9e8-053d885cc056 service nova] Acquiring lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updating instance_info_cache with network_info: [{"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Releasing lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Instance network_info: |[{"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9d95a0e6-4b33-451a-acc6-0f21cad3911d req-777f4978-cf40-43f1-a9e8-053d885cc056 service nova] Acquired lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG nova.network.neutron [req-9d95a0e6-4b33-451a-acc6-0f21cad3911d req-777f4978-cf40-43f1-a9e8-053d885cc056 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Refreshing network info cache for port fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:55 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:06:55 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:06:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8150MB free_disk=25.0074462890625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:06:56 user nova-compute[73476]: INFO nova.compute.manager [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Terminating instance
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3639bd9f-308c-4680-b18c-0720d6f18327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1d9efe64-6660-40cb-8710-c262210b5f08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance dadb69ec-5163-4e65-9656-3b80ee51fdf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance a106a9ab-407a-49b1-99fd-6406b89e065c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:06:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Instance destroyed successfully.
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.objects.instance [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lazy-loading 'resources' on Instance uuid dadb69ec-5163-4e65-9656-3b80ee51fdf0 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-891897880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-891897880',id=37,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkKX5RWHWnNaFPRwccSTJZClKfJCvxst9NrrwQIMgyEW01AEls4K3rtrSmyQitd/fHtBfBqYkZ8HNxZQAuEcfvKwbMHrWqgyAz98mLqVupumo0rYWaL5lDWnYqtiVxfSg==',key_name='tempest-keypair-1143520029',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:05:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69fdd3e8e61d47bd8a50affae1854448',ramdisk_id='',reservation_id='r-o05zd9bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-825342285',owner_user_name='tempest-AttachVolumeShelveTestJSON-825342285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:05:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23d582475c914098b5c6dce6268c2e2c',uuid=dadb69ec-5163-4e65-9656-3b80ee51fdf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converting VIF {"id": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "address": "fa:16:3e:7e:b1:ed", "network": {"id": "dab95af9-7454-4fc7-8a6d-03d4d81b6ddf", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1882729622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69fdd3e8e61d47bd8a50affae1854448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b5d65-8a", "ovs_interfaceid": "525b5d65-8ad1-445d-aa94-091fe68cbc0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG os_vif [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525b5d65-8a, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:06:56 user nova-compute[73476]: INFO os_vif [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=525b5d65-8ad1-445d-aa94-091fe68cbc0f,network=Network(dab95af9-7454-4fc7-8a6d-03d4d81b6ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b5d65-8a')
Aug 26 21:06:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Deleting instance files /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0_del
Aug 26 21:06:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Deletion of /opt/stack/data/nova/instances/dadb69ec-5163-4e65-9656-3b80ee51fdf0_del complete
Aug 26 21:06:56 user nova-compute[73476]: INFO nova.compute.manager [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 21:06:56 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:06:56 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG nova.network.neutron [req-9d95a0e6-4b33-451a-acc6-0f21cad3911d req-777f4978-cf40-43f1-a9e8-053d885cc056 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updated VIF entry in instance network info cache for port fd56409a-6505-48f2-95d2-8d0162ad28af. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG nova.network.neutron [req-9d95a0e6-4b33-451a-acc6-0f21cad3911d req-777f4978-cf40-43f1-a9e8-053d885cc056 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updating instance_info_cache with network_info: [{"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9d95a0e6-4b33-451a-acc6-0f21cad3911d req-777f4978-cf40-43f1-a9e8-053d885cc056 service nova] Releasing lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-2817031d-3b0b-4d48-919f-b68780bf57ab req-33de1e3a-4712-4c9f-9058-cfc58db2f236 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-unplugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2817031d-3b0b-4d48-919f-b68780bf57ab req-33de1e3a-4712-4c9f-9058-cfc58db2f236 service nova] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2817031d-3b0b-4d48-919f-b68780bf57ab req-33de1e3a-4712-4c9f-9058-cfc58db2f236 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2817031d-3b0b-4d48-919f-b68780bf57ab req-33de1e3a-4712-4c9f-9058-cfc58db2f236 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-2817031d-3b0b-4d48-919f-b68780bf57ab req-33de1e3a-4712-4c9f-9058-cfc58db2f236 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] No waiting events found dispatching network-vif-unplugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG nova.compute.manager [req-2817031d-3b0b-4d48-919f-b68780bf57ab req-33de1e3a-4712-4c9f-9058-cfc58db2f236 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-unplugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:06:57 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Took 0.88 seconds to deallocate network for instance.
Aug 26 21:06:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:58 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:06:58 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:06:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:06:58 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Deleted allocations for instance dadb69ec-5163-4e65-9656-3b80ee51fdf0
Aug 26 21:06:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-59146824-3e84-47d0-8388-aac15d570acb tempest-AttachVolumeShelveTestJSON-825342285 tempest-AttachVolumeShelveTestJSON-825342285-project-member] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.299s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:06:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-88ba9153-283f-4b36-90e2-c3fca4944d08 req-924b18ef-01e1-4391-813c-96ce586d4105 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:06:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-88ba9153-283f-4b36-90e2-c3fca4944d08 req-924b18ef-01e1-4391-813c-96ce586d4105 service nova] Acquiring lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:06:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-88ba9153-283f-4b36-90e2-c3fca4944d08 req-924b18ef-01e1-4391-813c-96ce586d4105 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:06:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-88ba9153-283f-4b36-90e2-c3fca4944d08 req-924b18ef-01e1-4391-813c-96ce586d4105 service nova] Lock "dadb69ec-5163-4e65-9656-3b80ee51fdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:06:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-88ba9153-283f-4b36-90e2-c3fca4944d08 req-924b18ef-01e1-4391-813c-96ce586d4105 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] No waiting events found dispatching network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:06:59 user nova-compute[73476]: WARNING nova.compute.manager [req-88ba9153-283f-4b36-90e2-c3fca4944d08 req-924b18ef-01e1-4391-813c-96ce586d4105 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received unexpected event network-vif-plugged-525b5d65-8ad1-445d-aa94-091fe68cbc0f for instance with vm_state deleted and task_state None.
Aug 26 21:06:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-88ba9153-283f-4b36-90e2-c3fca4944d08 req-924b18ef-01e1-4391-813c-96ce586d4105 service nova] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Received event network-vif-deleted-525b5d65-8ad1-445d-aa94-091fe68cbc0f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:01 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pydmRgHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:07:04 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:07:04 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:07:04 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7754b8-e314-46b2-b957-363fc7441ccb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:07:04 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b27c6f5-6ddf-463f-ab7f-7d5dfefc3e05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa] added
Aug 26 21:07:04 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[553fd14d-f23a-4900-8d98-14f004ac3432]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e399f67d-dacc-43d2-9183-a4f6441bb470]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pydmRgHX {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pydmRgHX" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b0a0ec-91dc-4107-b2be-df2301da1430]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pydmRgHX'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae7f27-71e0-48a7-a93a-52d56ddc81e9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4c09bb-319e-4c90-9003-73c7818f5bf5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:04 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:04 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd70ff0-d3d9-405d-85b8-1ce529b4b977]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa, portal: 172.16.0.220,3260]
Aug 26 21:07:04 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa, portal: 172.16.0.220,3260] successful.
Aug 26 21:07:04 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[175d4928-7917-490c-8cd7-e09c99088589]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[54613d53-110f-4266-811d-b7f2a2ae8abc]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:04 user nova-compute[73476]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)
Aug 26 21:07:04 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:04 user nova-compute[73476]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)
Aug 26 21:07:04 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c7bcc-91b8-45f0-9b68-eb91174b9e6c]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:04 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:07:05 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Creating image(s)
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Ensure instance console log exists: /opt/stack/data/nova/instances/a106a9ab-407a-49b1-99fd-6406b89e065c/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Start _get_guest_xml network_info=[{"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '4bbacfa2-6947-4bf6-946e-faa605a50239', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfHSJWBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a106a9ab-407a-49b1-99fd-6406b89e065c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5bb0c52-e50e-4105-8056-d750ce6bab6c', 'serial': 'e5bb0c52-e50e-4105-8056-d750ce6bab6c'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:07:05 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:07:05 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfHSJWBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:07:05 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pydmRgHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23663643535626162', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663643535626162', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:07:05 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:07:05 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.objects.instance [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'flavor' on Instance uuid 1d9efe64-6660-40cb-8710-c262210b5f08 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[71705854-41d3-4bea-a33d-9a136379729f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:07:05 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:07:05 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:07:05 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:07:05 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:07:05 user nova-compute[73476]:   <serial>1274e0e7-b358-44f7-92c4-85754d2f79aa</serial>
Aug 26 21:07:05 user nova-compute[73476]: </disk>
Aug 26 21:07:05 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a96c0d-6723-4890-bba1-222251e11fd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c] added
Aug 26 21:07:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c58585-0697-4d46-ac3d-887f27d1ce06]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d611a81-68fe-4763-921f-d34f9e20ab3b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NfHSJWBK {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NfHSJWBK" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a89c54e-3e23-4330-86dc-694916b8324b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NfHSJWBK'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ffe233-fb3c-4013-b0c2-2c04c1f678a5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f1fbf3-0ccb-412e-8de4-e7eda4f21591]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:05 user nova-compute[73476]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)
Aug 26 21:07:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:05 user nova-compute[73476]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)
Aug 26 21:07:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d1b8ce-a9ce-4b51-b007-9da737e7fb21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c, portal: 172.16.0.220,3260]
Aug 26 21:07:05 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c, portal: 172.16.0.220,3260] successful.
Aug 26 21:07:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37e6306-4022-4414-aebd-4c4d9340eb7b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5aaa2b-d487-46f0-a3c6-3547c25a9e9d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:05 user nova-compute[73476]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)
Aug 26 21:07:05 user nova-compute[73476]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:07:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:05 user nova-compute[73476]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)
Aug 26 21:07:05 user nova-compute[73476]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:07:05 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4898f995-9df2-45f5-970d-93429de9b855]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:07:05 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfHSJWBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] No VIF found with MAC fa:16:3e:6f:b8:ab, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-084b1094-2b24-4c67-bccd-f280a0c5ced9 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.894s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23962386236306432', 'path': '/dev/sdd'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962386236306432', 'path': '/dev/sdd'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-660909955',display_name='tempest-TestVolumeBootPattern-volume-backed-server-660909955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-660909955',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8vTZ7aRjlRJjU/l38wXc/lVUoh7D0ffTRruAL/XTRhWVAU/9JC0lVjWXgo3cexyEymfQP7JomD8l0d1P/p2PXazFF+bySic+M2u+v53jRHeMOz2OknztJrOVZPXA9tkA==',key_name='tempest-keypair-1638033829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-lmqpczvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:06:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=a106a9ab-407a-49b1-99fd-6406b89e065c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:01:48,bridge_name='br-int',has_traffic_filtering=True,id=fd56409a-6505-48f2-95d2-8d0162ad28af,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56409a-65') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'pci_devices' on Instance uuid a106a9ab-407a-49b1-99fd-6406b89e065c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:07:06 user nova-compute[73476]:   <uuid>a106a9ab-407a-49b1-99fd-6406b89e065c</uuid>
Aug 26 21:07:06 user nova-compute[73476]:   <name>instance-0000002c</name>
Aug 26 21:07:06 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:07:06 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:07:06 user nova-compute[73476]:   <metadata>
Aug 26 21:07:06 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:07:06 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:07:06 user nova-compute[73476]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-660909955</nova:name>
Aug 26 21:07:06 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:07:05</nova:creationTime>
Aug 26 21:07:06 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:07:06 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:07:06 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:07:06 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:07:06 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:07:06 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:07:06 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:07:06 user nova-compute[73476]:       <nova:owner>
Aug 26 21:07:06 user nova-compute[73476]:         <nova:user uuid="5bb1fc1180d34eb0ae98c52187aae87e">tempest-TestVolumeBootPattern-443030295-project-member</nova:user>
Aug 26 21:07:06 user nova-compute[73476]:         <nova:project uuid="a1962b32d78d4f6da29bb0fdaa001363">tempest-TestVolumeBootPattern-443030295</nova:project>
Aug 26 21:07:06 user nova-compute[73476]:       </nova:owner>
Aug 26 21:07:06 user nova-compute[73476]:       <nova:ports>
Aug 26 21:07:06 user nova-compute[73476]:         <nova:port uuid="fd56409a-6505-48f2-95d2-8d0162ad28af">
Aug 26 21:07:06 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 21:07:06 user nova-compute[73476]:         </nova:port>
Aug 26 21:07:06 user nova-compute[73476]:       </nova:ports>
Aug 26 21:07:06 user nova-compute[73476]:     </nova:instance>
Aug 26 21:07:06 user nova-compute[73476]:   </metadata>
Aug 26 21:07:06 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:07:06 user nova-compute[73476]:     <system>
Aug 26 21:07:06 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:07:06 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:07:06 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:07:06 user nova-compute[73476]:       <entry name="serial">a106a9ab-407a-49b1-99fd-6406b89e065c</entry>
Aug 26 21:07:06 user nova-compute[73476]:       <entry name="uuid">a106a9ab-407a-49b1-99fd-6406b89e065c</entry>
Aug 26 21:07:06 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:07:06 user nova-compute[73476]:     </system>
Aug 26 21:07:06 user nova-compute[73476]:   </sysinfo>
Aug 26 21:07:06 user nova-compute[73476]:   <os>
Aug 26 21:07:06 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:07:06 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:07:06 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:07:06 user nova-compute[73476]:   </os>
Aug 26 21:07:06 user nova-compute[73476]:   <features>
Aug 26 21:07:06 user nova-compute[73476]:     <acpi/>
Aug 26 21:07:06 user nova-compute[73476]:     <apic/>
Aug 26 21:07:06 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:07:06 user nova-compute[73476]:   </features>
Aug 26 21:07:06 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:07:06 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:07:06 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:07:06 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:07:06 user nova-compute[73476]:   </clock>
Aug 26 21:07:06 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:07:06 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:07:06 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:07:06 user nova-compute[73476]:   </cpu>
Aug 26 21:07:06 user nova-compute[73476]:   <devices>
Aug 26 21:07:06 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 21:07:06 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:07:06 user nova-compute[73476]:       <source dev="/dev/sdd"/>
Aug 26 21:07:06 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:07:06 user nova-compute[73476]:       <serial>e5bb0c52-e50e-4105-8056-d750ce6bab6c</serial>
Aug 26 21:07:06 user nova-compute[73476]:     </disk>
Aug 26 21:07:06 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:07:06 user nova-compute[73476]:       <mac address="fa:16:3e:88:01:48"/>
Aug 26 21:07:06 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:07:06 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:07:06 user nova-compute[73476]:       <target dev="tapfd56409a-65"/>
Aug 26 21:07:06 user nova-compute[73476]:     </interface>
Aug 26 21:07:06 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:07:06 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/a106a9ab-407a-49b1-99fd-6406b89e065c/console.log" append="off"/>
Aug 26 21:07:06 user nova-compute[73476]:     </serial>
Aug 26 21:07:06 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:07:06 user nova-compute[73476]:     <video>
Aug 26 21:07:06 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:07:06 user nova-compute[73476]:     </video>
Aug 26 21:07:06 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:07:06 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:07:06 user nova-compute[73476]:     </rng>
Aug 26 21:07:06 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:07:06 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:07:06 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:07:06 user nova-compute[73476]:     </memballoon>
Aug 26 21:07:06 user nova-compute[73476]:   </devices>
Aug 26 21:07:06 user nova-compute[73476]: </domain>
Aug 26 21:07:06 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-660909955',display_name='tempest-TestVolumeBootPattern-volume-backed-server-660909955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-660909955',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8vTZ7aRjlRJjU/l38wXc/lVUoh7D0ffTRruAL/XTRhWVAU/9JC0lVjWXgo3cexyEymfQP7JomD8l0d1P/p2PXazFF+bySic+M2u+v53jRHeMOz2OknztJrOVZPXA9tkA==',key_name='tempest-keypair-1638033829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-lmqpczvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:06:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=a106a9ab-407a-49b1-99fd-6406b89e065c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:01:48,bridge_name='br-int',has_traffic_filtering=True,id=fd56409a-6505-48f2-95d2-8d0162ad28af,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56409a-65') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG os_vif [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:01:48,bridge_name='br-int',has_traffic_filtering=True,id=fd56409a-6505-48f2-95d2-8d0162ad28af,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56409a-65') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd56409a-65, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd56409a-65, col_values=(('external_ids', {'iface-id': 'fd56409a-6505-48f2-95d2-8d0162ad28af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:01:48', 'vm-uuid': 'a106a9ab-407a-49b1-99fd-6406b89e065c'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:07:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:06 user nova-compute[73476]: INFO os_vif [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:01:48,bridge_name='br-int',has_traffic_filtering=True,id=fd56409a-6505-48f2-95d2-8d0162ad28af,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56409a-65')
Aug 26 21:07:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:07:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No VIF found with MAC fa:16:3e:88:01:48, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:07:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:07 user nova-compute[73476]: INFO nova.compute.manager [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Detaching volume 1274e0e7-b358-44f7-92c4-85754d2f79aa
Aug 26 21:07:07 user nova-compute[73476]: INFO nova.virt.block_device [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Attempting to driver detach volume 1274e0e7-b358-44f7-92c4-85754d2f79aa from mountpoint /dev/vdb
Aug 26 21:07:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Attempting to detach device vdb from instance 1d9efe64-6660-40cb-8710-c262210b5f08 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:07:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:07:07 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:07:07 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:07:07 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:07:07 user nova-compute[73476]:   <serial>1274e0e7-b358-44f7-92c4-85754d2f79aa</serial>
Aug 26 21:07:07 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:07:07 user nova-compute[73476]: </disk>
Aug 26 21:07:07 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:07:07 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Successfully detached device vdb from instance 1d9efe64-6660-40cb-8710-c262210b5f08 from the persistent domain config.
Aug 26 21:07:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d9efe64-6660-40cb-8710-c262210b5f08 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:07:07 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:07:07 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:07:07 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:07:07 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:07:07 user nova-compute[73476]:   <serial>1274e0e7-b358-44f7-92c4-85754d2f79aa</serial>
Aug 26 21:07:07 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:07:07 user nova-compute[73476]: </disk>
Aug 26 21:07:07 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693084028.1994724, 1d9efe64-6660-40cb-8710-c262210b5f08 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d9efe64-6660-40cb-8710-c262210b5f08 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:07:08 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Successfully detached device vdb from instance 1d9efe64-6660-40cb-8710-c262210b5f08 from the live domain config.
Aug 26 21:07:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pydmRgHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:07:08 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[478eae5f-a355-42fa-83f6-1e09958b9b23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[67afefd8-5e6f-477b-b9f9-9fc52df0677a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:08 user nova-compute[73476]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)
Aug 26 21:07:08 user nova-compute[73476]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:07:08 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:08 user nova-compute[73476]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa (non-flash)
Aug 26 21:07:08 user nova-compute[73476]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:07:08 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b0207eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ea7821-e6f4-453e-9312-fd31afac463b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[107063ff-bd40-49c1-a3fd-15ff2b2d7f7c]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb11723e-a1a7-4df3-989b-775db3a40c4b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a66285d-75f5-4f24-9452-48cfe12d34e5]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec38901-f010-4667-8b85-b839d2e2ec06]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d055950d-3e0f-47ec-90c1-9de4900c59aa]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa, portal: 172.16.0.220,3260]
Aug 26 21:07:08 user nova-compute[73476]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa, portal: 172.16.0.220,3260] successful.
Aug 26 21:07:08 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1274e0e7-b358-44f7-92c4-85754d2f79aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a36b1b-b79d-4d10-b26a-b30bc5a8fc8f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] <== disconnect_volume: return (286ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-17f293a5-04ec-4bb2-bc19-2ee9979af940 req-f284ad5e-f611-43d4-901f-f11dd4e4dc99 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received event network-vif-plugged-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-17f293a5-04ec-4bb2-bc19-2ee9979af940 req-f284ad5e-f611-43d4-901f-f11dd4e4dc99 service nova] Acquiring lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-17f293a5-04ec-4bb2-bc19-2ee9979af940 req-f284ad5e-f611-43d4-901f-f11dd4e4dc99 service nova] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-17f293a5-04ec-4bb2-bc19-2ee9979af940 req-f284ad5e-f611-43d4-901f-f11dd4e4dc99 service nova] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-17f293a5-04ec-4bb2-bc19-2ee9979af940 req-f284ad5e-f611-43d4-901f-f11dd4e4dc99 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] No waiting events found dispatching network-vif-plugged-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:07:08 user nova-compute[73476]: WARNING nova.compute.manager [req-17f293a5-04ec-4bb2-bc19-2ee9979af940 req-f284ad5e-f611-43d4-901f-f11dd4e4dc99 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received unexpected event network-vif-plugged-fd56409a-6505-48f2-95d2-8d0162ad28af for instance with vm_state building and task_state spawning.
Aug 26 21:07:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:09 user nova-compute[73476]: DEBUG nova.objects.instance [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'flavor' on Instance uuid 1d9efe64-6660-40cb-8710-c262210b5f08 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:07:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-125ea31a-41d2-4999-b142-5c35c407f5d0 tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.959s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084030.6974373, a106a9ab-407a-49b1-99fd-6406b89e065c => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:07:10 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] VM Resumed (Lifecycle Event)
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:07:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Instance spawned successfully.
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:10 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084030.7009382, a106a9ab-407a-49b1-99fd-6406b89e065c => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:07:10 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] VM Started (Lifecycle Event)
Aug 26 21:07:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:07:10 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:07:10 user nova-compute[73476]: INFO nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Took 5.30 seconds to spawn the instance on the hypervisor.
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-4a6fe004-9e7e-415a-8d19-ce1f87b50ea0 req-5dde9f6a-51e7-46ea-b46a-dba83e2020b4 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received event network-vif-plugged-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4a6fe004-9e7e-415a-8d19-ce1f87b50ea0 req-5dde9f6a-51e7-46ea-b46a-dba83e2020b4 service nova] Acquiring lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4a6fe004-9e7e-415a-8d19-ce1f87b50ea0 req-5dde9f6a-51e7-46ea-b46a-dba83e2020b4 service nova] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4a6fe004-9e7e-415a-8d19-ce1f87b50ea0 req-5dde9f6a-51e7-46ea-b46a-dba83e2020b4 service nova] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:10 user nova-compute[73476]: DEBUG nova.compute.manager [req-4a6fe004-9e7e-415a-8d19-ce1f87b50ea0 req-5dde9f6a-51e7-46ea-b46a-dba83e2020b4 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] No waiting events found dispatching network-vif-plugged-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:07:10 user nova-compute[73476]: WARNING nova.compute.manager [req-4a6fe004-9e7e-415a-8d19-ce1f87b50ea0 req-5dde9f6a-51e7-46ea-b46a-dba83e2020b4 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received unexpected event network-vif-plugged-fd56409a-6505-48f2-95d2-8d0162ad28af for instance with vm_state building and task_state spawning.
Aug 26 21:07:10 user nova-compute[73476]: INFO nova.compute.manager [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Took 18.39 seconds to build instance.
Aug 26 21:07:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1f64c1bb-d521-43fc-bbb3-20e6749afeea tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.484s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:11 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084016.8303154, dadb69ec-5163-4e65-9656-3b80ee51fdf0 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:07:11 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] VM Stopped (Lifecycle Event)
Aug 26 21:07:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-20abd819-feb1-4a8a-9a15-9f18ee58abe6 None None] [instance: dadb69ec-5163-4e65-9656-3b80ee51fdf0] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:07:17 user nova-compute[73476]: INFO nova.compute.claims [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Claim successful on node user
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.network.neutron [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:07:17 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.policy [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9fdaeb7bcc6482e87bb4b9757c5ff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b84b4dda8794d89a3b826169d3622ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:07:17 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Creating image(s)
Aug 26 21:07:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "/opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "/opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "/opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.284s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk 1073741824" returned: 0 in 0.061s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.353s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG nova.network.neutron [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Successfully created port: 46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.172s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Cannot resize image /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Ensure instance console log exists: /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Successfully updated port: 46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "refresh_cache-e83b1e40-a97f-45bc-a948-3b1187feb8d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquired lock "refresh_cache-e83b1e40-a97f-45bc-a948-3b1187feb8d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-ab844396-e1fb-42c8-9546-92caa495eb43 req-b9702a63-5bd8-4297-96bd-00b726f038c7 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-changed-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-ab844396-e1fb-42c8-9546-92caa495eb43 req-b9702a63-5bd8-4297-96bd-00b726f038c7 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Refreshing instance network info cache due to event network-changed-46a89aff-432c-46c9-a47f-ec64d7ba894f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ab844396-e1fb-42c8-9546-92caa495eb43 req-b9702a63-5bd8-4297-96bd-00b726f038c7 service nova] Acquiring lock "refresh_cache-e83b1e40-a97f-45bc-a948-3b1187feb8d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Updating instance_info_cache with network_info: [{"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Releasing lock "refresh_cache-e83b1e40-a97f-45bc-a948-3b1187feb8d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Instance network_info: |[{"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ab844396-e1fb-42c8-9546-92caa495eb43 req-b9702a63-5bd8-4297-96bd-00b726f038c7 service nova] Acquired lock "refresh_cache-e83b1e40-a97f-45bc-a948-3b1187feb8d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.network.neutron [req-ab844396-e1fb-42c8-9546-92caa495eb43 req-b9702a63-5bd8-4297-96bd-00b726f038c7 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Refreshing network info cache for port 46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Start _get_guest_xml network_info=[{"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:07:19 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:07:19 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1436531964',display_name='tempest-VolumesSnapshotTestJSON-instance-1436531964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1436531964',id=45,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyKxWsek03dkRlpmsnl0JaL2McUEQ7LoPjkWevirLEnW9RX1yR2Vqe6quOtVkdzjlN7gKHpSnZ/Z/aFcUHLk50ZUnZg/MMbretW6a8coleZ6xodPBmhRHwYkdethXDCRQ==',key_name='tempest-keypair-1252023387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b84b4dda8794d89a3b826169d3622ae',ramdisk_id='',reservation_id='r-w7r37cew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1103521950',owner_user_name='tempest-VolumesSnapshotTestJSON-1103521950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9fdaeb7bcc6482e87bb4b9757c5ff94',uuid=e83b1e40-a97f-45bc-a948-3b1187feb8d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converting VIF {"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:37:b2,bridge_name='br-int',has_traffic_filtering=True,id=46a89aff-432c-46c9-a47f-ec64d7ba894f,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a89aff-43') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.objects.instance [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'pci_devices' on Instance uuid e83b1e40-a97f-45bc-a948-3b1187feb8d4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:07:19 user nova-compute[73476]:   <uuid>e83b1e40-a97f-45bc-a948-3b1187feb8d4</uuid>
Aug 26 21:07:19 user nova-compute[73476]:   <name>instance-0000002d</name>
Aug 26 21:07:19 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:07:19 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:07:19 user nova-compute[73476]:   <metadata>
Aug 26 21:07:19 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:07:19 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:07:19 user nova-compute[73476]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1436531964</nova:name>
Aug 26 21:07:19 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:07:19</nova:creationTime>
Aug 26 21:07:19 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:07:19 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:07:19 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:07:19 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:07:19 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:07:19 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:07:19 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:07:19 user nova-compute[73476]:       <nova:owner>
Aug 26 21:07:19 user nova-compute[73476]:         <nova:user uuid="a9fdaeb7bcc6482e87bb4b9757c5ff94">tempest-VolumesSnapshotTestJSON-1103521950-project-member</nova:user>
Aug 26 21:07:19 user nova-compute[73476]:         <nova:project uuid="8b84b4dda8794d89a3b826169d3622ae">tempest-VolumesSnapshotTestJSON-1103521950</nova:project>
Aug 26 21:07:19 user nova-compute[73476]:       </nova:owner>
Aug 26 21:07:19 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:07:19 user nova-compute[73476]:       <nova:ports>
Aug 26 21:07:19 user nova-compute[73476]:         <nova:port uuid="46a89aff-432c-46c9-a47f-ec64d7ba894f">
Aug 26 21:07:19 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 21:07:19 user nova-compute[73476]:         </nova:port>
Aug 26 21:07:19 user nova-compute[73476]:       </nova:ports>
Aug 26 21:07:19 user nova-compute[73476]:     </nova:instance>
Aug 26 21:07:19 user nova-compute[73476]:   </metadata>
Aug 26 21:07:19 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:07:19 user nova-compute[73476]:     <system>
Aug 26 21:07:19 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:07:19 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:07:19 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:07:19 user nova-compute[73476]:       <entry name="serial">e83b1e40-a97f-45bc-a948-3b1187feb8d4</entry>
Aug 26 21:07:19 user nova-compute[73476]:       <entry name="uuid">e83b1e40-a97f-45bc-a948-3b1187feb8d4</entry>
Aug 26 21:07:19 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:07:19 user nova-compute[73476]:     </system>
Aug 26 21:07:19 user nova-compute[73476]:   </sysinfo>
Aug 26 21:07:19 user nova-compute[73476]:   <os>
Aug 26 21:07:19 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:07:19 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:07:19 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:07:19 user nova-compute[73476]:   </os>
Aug 26 21:07:19 user nova-compute[73476]:   <features>
Aug 26 21:07:19 user nova-compute[73476]:     <acpi/>
Aug 26 21:07:19 user nova-compute[73476]:     <apic/>
Aug 26 21:07:19 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:07:19 user nova-compute[73476]:   </features>
Aug 26 21:07:19 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:07:19 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:07:19 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:07:19 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:07:19 user nova-compute[73476]:   </clock>
Aug 26 21:07:19 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:07:19 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:07:19 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:07:19 user nova-compute[73476]:   </cpu>
Aug 26 21:07:19 user nova-compute[73476]:   <devices>
Aug 26 21:07:19 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:07:19 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:07:19 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk"/>
Aug 26 21:07:19 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:07:19 user nova-compute[73476]:     </disk>
Aug 26 21:07:19 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:07:19 user nova-compute[73476]:       <mac address="fa:16:3e:7d:37:b2"/>
Aug 26 21:07:19 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:07:19 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:07:19 user nova-compute[73476]:       <target dev="tap46a89aff-43"/>
Aug 26 21:07:19 user nova-compute[73476]:     </interface>
Aug 26 21:07:19 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:07:19 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/console.log" append="off"/>
Aug 26 21:07:19 user nova-compute[73476]:     </serial>
Aug 26 21:07:19 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:07:19 user nova-compute[73476]:     <video>
Aug 26 21:07:19 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:07:19 user nova-compute[73476]:     </video>
Aug 26 21:07:19 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:07:19 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:07:19 user nova-compute[73476]:     </rng>
Aug 26 21:07:19 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:07:19 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:07:19 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:07:19 user nova-compute[73476]:     </memballoon>
Aug 26 21:07:19 user nova-compute[73476]:   </devices>
Aug 26 21:07:19 user nova-compute[73476]: </domain>
Aug 26 21:07:19 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1436531964',display_name='tempest-VolumesSnapshotTestJSON-instance-1436531964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1436531964',id=45,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyKxWsek03dkRlpmsnl0JaL2McUEQ7LoPjkWevirLEnW9RX1yR2Vqe6quOtVkdzjlN7gKHpSnZ/Z/aFcUHLk50ZUnZg/MMbretW6a8coleZ6xodPBmhRHwYkdethXDCRQ==',key_name='tempest-keypair-1252023387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b84b4dda8794d89a3b826169d3622ae',ramdisk_id='',reservation_id='r-w7r37cew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1103521950',owner_user_name='tempest-VolumesSnapshotTestJSON-1103521950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9fdaeb7bcc6482e87bb4b9757c5ff94',uuid=e83b1e40-a97f-45bc-a948-3b1187feb8d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converting VIF {"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:37:b2,bridge_name='br-int',has_traffic_filtering=True,id=46a89aff-432c-46c9-a47f-ec64d7ba894f,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a89aff-43') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG os_vif [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:37:b2,bridge_name='br-int',has_traffic_filtering=True,id=46a89aff-432c-46c9-a47f-ec64d7ba894f,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a89aff-43') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46a89aff-43, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46a89aff-43, col_values=(('external_ids', {'iface-id': '46a89aff-432c-46c9-a47f-ec64d7ba894f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:37:b2', 'vm-uuid': 'e83b1e40-a97f-45bc-a948-3b1187feb8d4'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:19 user nova-compute[73476]: INFO os_vif [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:37:b2,bridge_name='br-int',has_traffic_filtering=True,id=46a89aff-432c-46c9-a47f-ec64d7ba894f,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a89aff-43')
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:07:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No VIF found with MAC fa:16:3e:7d:37:b2, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:07:20 user nova-compute[73476]: DEBUG nova.network.neutron [req-ab844396-e1fb-42c8-9546-92caa495eb43 req-b9702a63-5bd8-4297-96bd-00b726f038c7 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Updated VIF entry in instance network info cache for port 46a89aff-432c-46c9-a47f-ec64d7ba894f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:07:20 user nova-compute[73476]: DEBUG nova.network.neutron [req-ab844396-e1fb-42c8-9546-92caa495eb43 req-b9702a63-5bd8-4297-96bd-00b726f038c7 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Updating instance_info_cache with network_info: [{"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:07:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ab844396-e1fb-42c8-9546-92caa495eb43 req-b9702a63-5bd8-4297-96bd-00b726f038c7 service nova] Releasing lock "refresh_cache-e83b1e40-a97f-45bc-a948-3b1187feb8d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:07:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-f06b7981-c8c9-4045-9f45-6097280cf653 req-0836692d-5b9f-4ca9-9e50-89f5e7a4de9a service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f06b7981-c8c9-4045-9f45-6097280cf653 req-0836692d-5b9f-4ca9-9e50-89f5e7a4de9a service nova] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f06b7981-c8c9-4045-9f45-6097280cf653 req-0836692d-5b9f-4ca9-9e50-89f5e7a4de9a service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f06b7981-c8c9-4045-9f45-6097280cf653 req-0836692d-5b9f-4ca9-9e50-89f5e7a4de9a service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-f06b7981-c8c9-4045-9f45-6097280cf653 req-0836692d-5b9f-4ca9-9e50-89f5e7a4de9a service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] No waiting events found dispatching network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:07:21 user nova-compute[73476]: WARNING nova.compute.manager [req-f06b7981-c8c9-4045-9f45-6097280cf653 req-0836692d-5b9f-4ca9-9e50-89f5e7a4de9a service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received unexpected event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f for instance with vm_state building and task_state spawning.
Aug 26 21:07:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084043.2471092, e83b1e40-a97f-45bc-a948-3b1187feb8d4 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:07:23 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] VM Resumed (Lifecycle Event)
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:07:23 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Instance spawned successfully.
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:07:23 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084043.2483964, e83b1e40-a97f-45bc-a948-3b1187feb8d4 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:07:23 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] VM Started (Lifecycle Event)
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:07:23 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:07:23 user nova-compute[73476]: INFO nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:23 user nova-compute[73476]: INFO nova.compute.manager [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Took 6.19 seconds to build instance.
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-489b33aa-347a-48ae-aa16-deedcff15345 req-5d7fa0ce-70a9-4b33-87ed-37c6024b0429 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-489b33aa-347a-48ae-aa16-deedcff15345 req-5d7fa0ce-70a9-4b33-87ed-37c6024b0429 service nova] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-489b33aa-347a-48ae-aa16-deedcff15345 req-5d7fa0ce-70a9-4b33-87ed-37c6024b0429 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-489b33aa-347a-48ae-aa16-deedcff15345 req-5d7fa0ce-70a9-4b33-87ed-37c6024b0429 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-489b33aa-347a-48ae-aa16-deedcff15345 req-5d7fa0ce-70a9-4b33-87ed-37c6024b0429 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] No waiting events found dispatching network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:07:23 user nova-compute[73476]: WARNING nova.compute.manager [req-489b33aa-347a-48ae-aa16-deedcff15345 req-5d7fa0ce-70a9-4b33-87ed-37c6024b0429 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received unexpected event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f for instance with vm_state active and task_state None.
Aug 26 21:07:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-321afa19-7e18-4c00-bdd9-f810742208ff tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.304s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:30 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:30 user nova-compute[73476]: INFO nova.compute.manager [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Detaching volume 8e0751f6-3f51-43e0-a361-09a663650561
Aug 26 21:07:31 user nova-compute[73476]: INFO nova.virt.block_device [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Attempting to driver detach volume 8e0751f6-3f51-43e0-a361-09a663650561 from mountpoint /dev/vdb
Aug 26 21:07:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Attempting to detach device vdb from instance 7d07fece-58a4-46ec-902c-f1506956d1fa from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:07:31 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:07:31 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 21:07:31 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:07:31 user nova-compute[73476]:   <serial>8e0751f6-3f51-43e0-a361-09a663650561</serial>
Aug 26 21:07:31 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 21:07:31 user nova-compute[73476]: </disk>
Aug 26 21:07:31 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:07:31 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully detached device vdb from instance 7d07fece-58a4-46ec-902c-f1506956d1fa from the persistent domain config.
Aug 26 21:07:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d07fece-58a4-46ec-902c-f1506956d1fa from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:07:31 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:07:31 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 21:07:31 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:07:31 user nova-compute[73476]:   <serial>8e0751f6-3f51-43e0-a361-09a663650561</serial>
Aug 26 21:07:31 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 21:07:31 user nova-compute[73476]: </disk>
Aug 26 21:07:31 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693084051.5031912, 7d07fece-58a4-46ec-902c-f1506956d1fa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:07:31 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully detached device vdb from instance 7d07fece-58a4-46ec-902c-f1506956d1fa from the live domain config.
Aug 26 21:07:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzDMoRha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:07:31 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63a214a-67d5-4f7c-b791-fbc3f7b50290]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a70199-3723-4751-8991-6a3367ecdef7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:31 user nova-compute[73476]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:07:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 (non-flash)
Aug 26 21:07:31 user nova-compute[73476]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:07:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258cf331c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc5277f-f15e-4481-8729-ed7426aa44f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb21c197-3665-485e-850d-cbf6930bf56e]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fd1e36-e9db-468a-816b-9544214e3ca0]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[950102e4-9555-4d35-a37a-0519e2ec237d]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95780ce-020f-486c-af88-105bf7db8d98]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ba15a9-c15c-45f6-bad9-d8c46d662697]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260]
Aug 26 21:07:31 user nova-compute[73476]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561, portal: 172.16.0.220,3260] successful.
Aug 26 21:07:31 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0751f6-3f51-43e0-a361-09a663650561 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc0c4fc-4261-4538-9258-7b2cae88723b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== disconnect_volume: return (259ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:07:31 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:07:32 user nova-compute[73476]: DEBUG nova.objects.instance [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:07:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a690d2b8-8ec1-4b38-ae55-bd28f3e45534 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.626s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2810042c-d357-4ce4-b419-9bc63ebd24fc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2810042c-d357-4ce4-b419-9bc63ebd24fc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2810042c-d357-4ce4-b419-9bc63ebd24fc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2810042c-d357-4ce4-b419-9bc63ebd24fc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73476) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2810042c-d357-4ce4-b419-9bc63ebd24fc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-a359e3f4-202f-48d1-902f-f4a43183bf24 req-ae88019d-8493-442d-a534-dd8e531f94bc service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-unplugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a359e3f4-202f-48d1-902f-f4a43183bf24 req-ae88019d-8493-442d-a534-dd8e531f94bc service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a359e3f4-202f-48d1-902f-f4a43183bf24 req-ae88019d-8493-442d-a534-dd8e531f94bc service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a359e3f4-202f-48d1-902f-f4a43183bf24 req-ae88019d-8493-442d-a534-dd8e531f94bc service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:33 user nova-compute[73476]: DEBUG nova.compute.manager [req-a359e3f4-202f-48d1-902f-f4a43183bf24 req-ae88019d-8493-442d-a534-dd8e531f94bc service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-unplugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:07:33 user nova-compute[73476]: WARNING nova.compute.manager [req-a359e3f4-202f-48d1-902f-f4a43183bf24 req-ae88019d-8493-442d-a534-dd8e531f94bc service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-unplugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state active and task_state powering-off.
Aug 26 21:07:34 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance destroyed successfully.
Aug 26 21:07:34 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2810042c-d357-4ce4-b419-9bc63ebd24fc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:34 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2810042c-d357-4ce4-b419-9bc63ebd24fc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.950s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-79094b00-20bb-45f0-8230-5746ff30537e req-c50f5438-5bb9-425f-9b2c-4b398121e9e6 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-79094b00-20bb-45f0-8230-5746ff30537e req-c50f5438-5bb9-425f-9b2c-4b398121e9e6 service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-79094b00-20bb-45f0-8230-5746ff30537e req-c50f5438-5bb9-425f-9b2c-4b398121e9e6 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-79094b00-20bb-45f0-8230-5746ff30537e req-c50f5438-5bb9-425f-9b2c-4b398121e9e6 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:35 user nova-compute[73476]: DEBUG nova.compute.manager [req-79094b00-20bb-45f0-8230-5746ff30537e req-c50f5438-5bb9-425f-9b2c-4b398121e9e6 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:07:35 user nova-compute[73476]: WARNING nova.compute.manager [req-79094b00-20bb-45f0-8230-5746ff30537e req-c50f5438-5bb9-425f-9b2c-4b398121e9e6 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state stopped and task_state None.
Aug 26 21:07:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:40 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73476) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 21:07:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:41 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:41 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:07:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:45 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:45 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:49 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084054.146528, 7d07fece-58a4-46ec-902c-f1506956d1fa => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:07:49 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] VM Stopped (Lifecycle Event)
Aug 26 21:07:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-601d97a1-b9eb-4624-9d6d-364cd28e525e None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:07:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-601d97a1-b9eb-4624-9d6d-364cd28e525e None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:07:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:07:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:07:52 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:52 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:07:52 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:07:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:07:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:55 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:07:55 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8022MB free_disk=25.003681182861328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3639bd9f-308c-4680-b18c-0720d6f18327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1d9efe64-6660-40cb-8710-c262210b5f08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance a106a9ab-407a-49b1-99fd-6406b89e065c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e83b1e40-a97f-45bc-a948-3b1187feb8d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing inventories for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating ProviderTree inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing aggregate associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, aggregates: None {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing trait associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:07:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-a9325365-78fe-4429-960f-cf6ec93bea6f req-2e912e28-f50c-4fbc-a5c3-6e1d15007697 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received event network-changed-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG nova.compute.manager [req-a9325365-78fe-4429-960f-cf6ec93bea6f req-2e912e28-f50c-4fbc-a5c3-6e1d15007697 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Refreshing instance network info cache due to event network-changed-696cc9bf-5a5c-4771-b808-44d0b0c7605f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a9325365-78fe-4429-960f-cf6ec93bea6f req-2e912e28-f50c-4fbc-a5c3-6e1d15007697 service nova] Acquiring lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a9325365-78fe-4429-960f-cf6ec93bea6f req-2e912e28-f50c-4fbc-a5c3-6e1d15007697 service nova] Acquired lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG nova.network.neutron [req-a9325365-78fe-4429-960f-cf6ec93bea6f req-2e912e28-f50c-4fbc-a5c3-6e1d15007697 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Refreshing network info cache for port 696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:58 user nova-compute[73476]: INFO nova.compute.manager [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Terminating instance
Aug 26 21:07:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-6030f07f-3311-4ae5-9e5d-77bc04b82cd5 req-8d85a374-942d-4801-a252-e48df55666b4 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received event network-vif-unplugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6030f07f-3311-4ae5-9e5d-77bc04b82cd5 req-8d85a374-942d-4801-a252-e48df55666b4 service nova] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6030f07f-3311-4ae5-9e5d-77bc04b82cd5 req-8d85a374-942d-4801-a252-e48df55666b4 service nova] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6030f07f-3311-4ae5-9e5d-77bc04b82cd5 req-8d85a374-942d-4801-a252-e48df55666b4 service nova] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-6030f07f-3311-4ae5-9e5d-77bc04b82cd5 req-8d85a374-942d-4801-a252-e48df55666b4 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] No waiting events found dispatching network-vif-unplugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-6030f07f-3311-4ae5-9e5d-77bc04b82cd5 req-8d85a374-942d-4801-a252-e48df55666b4 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received event network-vif-unplugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.network.neutron [req-a9325365-78fe-4429-960f-cf6ec93bea6f req-2e912e28-f50c-4fbc-a5c3-6e1d15007697 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Updated VIF entry in instance network info cache for port 696cc9bf-5a5c-4771-b808-44d0b0c7605f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.network.neutron [req-a9325365-78fe-4429-960f-cf6ec93bea6f req-2e912e28-f50c-4fbc-a5c3-6e1d15007697 service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Updating instance_info_cache with network_info: [{"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:07:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Instance destroyed successfully.
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.objects.instance [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'resources' on Instance uuid 1d9efe64-6660-40cb-8710-c262210b5f08 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a9325365-78fe-4429-960f-cf6ec93bea6f req-2e912e28-f50c-4fbc-a5c3-6e1d15007697 service nova] Releasing lock "refresh_cache-1d9efe64-6660-40cb-8710-c262210b5f08" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2050043676',display_name='tempest-TestStampPattern-server-2050043676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2050043676',id=43,image_ref='66d09f29-660a-452f-8560-f318991c06cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBJxN4wvMn8Jar6NrIBiYVMiu3vgfLkl6323Mn8p765asBJjOSbk1YLZEFjYoYJLW4VOzDi5yHEmiOk8JKFOVGKLi4tNN1pZeSYxVVQ4b/Q10+a3fyslhJc+nWG56XtGA==',key_name='tempest-TestStampPattern-1984164735',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:05:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='273b5f4f187d4443b5b2e563133b60b4',ramdisk_id='',reservation_id='r-l7ty1faj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3639bd9f-308c-4680-b18c-0720d6f18327',image_min_disk='1',image_min_ram='0',image_owner_id='273b5f4f187d4443b5b2e563133b60b4',image_owner_project_name='tempest-TestStampPattern-1638669422',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1638669422-project-member',image_user_id='7600fe3f150b40b8a9905a7590aa2bf2',owner_project_name='tempest-TestStampPattern-1638669422',owner_user_name='tempest-TestStampPattern-1638669422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:05:07Z,user_data=None,user_id='7600fe3f150b40b8a9905a7590aa2bf2',uuid=1d9efe64-6660-40cb-8710-c262210b5f08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converting VIF {"id": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "address": "fa:16:3e:6f:b8:ab", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap696cc9bf-5a", "ovs_interfaceid": "696cc9bf-5a5c-4771-b808-44d0b0c7605f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:b8:ab,bridge_name='br-int',has_traffic_filtering=True,id=696cc9bf-5a5c-4771-b808-44d0b0c7605f,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696cc9bf-5a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG os_vif [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:b8:ab,bridge_name='br-int',has_traffic_filtering=True,id=696cc9bf-5a5c-4771-b808-44d0b0c7605f,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696cc9bf-5a') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap696cc9bf-5a, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:07:59 user nova-compute[73476]: INFO os_vif [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:b8:ab,bridge_name='br-int',has_traffic_filtering=True,id=696cc9bf-5a5c-4771-b808-44d0b0c7605f,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap696cc9bf-5a')
Aug 26 21:07:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Deleting instance files /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08_del
Aug 26 21:07:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Deletion of /opt/stack/data/nova/instances/1d9efe64-6660-40cb-8710-c262210b5f08_del complete
Aug 26 21:07:59 user nova-compute[73476]: INFO nova.compute.manager [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 26 21:07:59 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:07:59 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:07:59 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Took 0.53 seconds to deallocate network for instance.
Aug 26 21:08:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:00 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:08:00 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:08:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:00 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Deleted allocations for instance 1d9efe64-6660-40cb-8710-c262210b5f08
Aug 26 21:08:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-5b785f11-15ea-4e2f-8d00-556d3f841f7e tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "1d9efe64-6660-40cb-8710-c262210b5f08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-bf8f9dbe-2fef-416f-bc29-628080df8c5f req-088b5688-a4ac-44aa-9d65-c522c04d000e service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received event network-vif-plugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:08:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bf8f9dbe-2fef-416f-bc29-628080df8c5f req-088b5688-a4ac-44aa-9d65-c522c04d000e service nova] Acquiring lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bf8f9dbe-2fef-416f-bc29-628080df8c5f req-088b5688-a4ac-44aa-9d65-c522c04d000e service nova] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-bf8f9dbe-2fef-416f-bc29-628080df8c5f req-088b5688-a4ac-44aa-9d65-c522c04d000e service nova] Lock "1d9efe64-6660-40cb-8710-c262210b5f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-bf8f9dbe-2fef-416f-bc29-628080df8c5f req-088b5688-a4ac-44aa-9d65-c522c04d000e service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] No waiting events found dispatching network-vif-plugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:08:01 user nova-compute[73476]: WARNING nova.compute.manager [req-bf8f9dbe-2fef-416f-bc29-628080df8c5f req-088b5688-a4ac-44aa-9d65-c522c04d000e service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received unexpected event network-vif-plugged-696cc9bf-5a5c-4771-b808-44d0b0c7605f for instance with vm_state deleted and task_state None.
Aug 26 21:08:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-bf8f9dbe-2fef-416f-bc29-628080df8c5f req-088b5688-a4ac-44aa-9d65-c522c04d000e service nova] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Received event network-vif-deleted-696cc9bf-5a5c-4771-b808-44d0b0c7605f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:08:03 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:08 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:10 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 21:08:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] There are 0 instances to clean {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 21:08:14 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084079.280859, 1d9efe64-6660-40cb-8710-c262210b5f08 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:08:14 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] VM Stopped (Lifecycle Event)
Aug 26 21:08:14 user nova-compute[73476]: DEBUG nova.compute.manager [None req-3335df68-f1a8-42a1-aeca-f360a60d6cbd None None] [instance: 1d9efe64-6660-40cb-8710-c262210b5f08] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:08:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:08:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:08:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:08:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:08:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:08:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:08:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:08:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:08:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 3639bd9f-308c-4680-b18c-0720d6f18327 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid a106a9ab-407a-49b1-99fd-6406b89e065c {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid e83b1e40-a97f-45bc-a948-3b1187feb8d4 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "a106a9ab-407a-49b1-99fd-6406b89e065c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:35 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:42 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:08:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-4a9b22e4-5214-4b10-9929-31636eb1d953 req-73772e04-adbf-4aac-ac5e-ffb839928763 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received event network-changed-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:08:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-4a9b22e4-5214-4b10-9929-31636eb1d953 req-73772e04-adbf-4aac-ac5e-ffb839928763 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Refreshing instance network info cache due to event network-changed-fd56409a-6505-48f2-95d2-8d0162ad28af. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:08:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4a9b22e4-5214-4b10-9929-31636eb1d953 req-73772e04-adbf-4aac-ac5e-ffb839928763 service nova] Acquiring lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:08:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4a9b22e4-5214-4b10-9929-31636eb1d953 req-73772e04-adbf-4aac-ac5e-ffb839928763 service nova] Acquired lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:08:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-4a9b22e4-5214-4b10-9929-31636eb1d953 req-73772e04-adbf-4aac-ac5e-ffb839928763 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Refreshing network info cache for port fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:08:44 user nova-compute[73476]: DEBUG nova.network.neutron [req-4a9b22e4-5214-4b10-9929-31636eb1d953 req-73772e04-adbf-4aac-ac5e-ffb839928763 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updated VIF entry in instance network info cache for port fd56409a-6505-48f2-95d2-8d0162ad28af. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:08:44 user nova-compute[73476]: DEBUG nova.network.neutron [req-4a9b22e4-5214-4b10-9929-31636eb1d953 req-73772e04-adbf-4aac-ac5e-ffb839928763 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updating instance_info_cache with network_info: [{"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:08:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4a9b22e4-5214-4b10-9929-31636eb1d953 req-73772e04-adbf-4aac-ac5e-ffb839928763 service nova] Releasing lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:08:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:08:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:08:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:08:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:08:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:45 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:48 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:49 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:52 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:08:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:08:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:08:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:08:52 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:08:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updating instance_info_cache with network_info: [{"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-2ccfbf89-2c87-499b-b7c6-a8fd656cde37" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:08:53 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:08:54 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:08:55 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:08:55 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:08:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8252MB free_disk=24.994384765625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3639bd9f-308c-4680-b18c-0720d6f18327 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance a106a9ab-407a-49b1-99fd-6406b89e065c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e83b1e40-a97f-45bc-a948-3b1187feb8d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:08:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:08:56 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:08:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:08:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:08:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:08:58 user nova-compute[73476]: INFO nova.compute.claims [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Claim successful on node user
Aug 26 21:08:58 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:08:58 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:08:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:08:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:08:58 user nova-compute[73476]: INFO nova.virt.block_device [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Booting with volume snapshot e64ab935-0dd5-481e-8705-510d76fa9561 at /dev/vda
Aug 26 21:08:58 user nova-compute[73476]: DEBUG nova.policy [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bb1fc1180d34eb0ae98c52187aae87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1962b32d78d4f6da29bb0fdaa001363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:08:59 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:08:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:08:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Successfully created port: 1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:08:59 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Successfully updated port: 1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "refresh_cache-ca9be6ac-5cac-410a-92cb-f4c295ff99d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquired lock "refresh_cache-ca9be6ac-5cac-410a-92cb-f4c295ff99d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-cf43a754-4403-40cd-9763-93ccff4f84ce req-3cdf7682-e375-4278-8891-7ce2217093b4 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received event network-changed-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG nova.compute.manager [req-cf43a754-4403-40cd-9763-93ccff4f84ce req-3cdf7682-e375-4278-8891-7ce2217093b4 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Refreshing instance network info cache due to event network-changed-1726da42-d0d1-4bd9-9928-5b157efd1e26. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cf43a754-4403-40cd-9763-93ccff4f84ce req-3cdf7682-e375-4278-8891-7ce2217093b4 service nova] Acquiring lock "refresh_cache-ca9be6ac-5cac-410a-92cb-f4c295ff99d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Updating instance_info_cache with network_info: [{"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Releasing lock "refresh_cache-ca9be6ac-5cac-410a-92cb-f4c295ff99d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Instance network_info: |[{"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cf43a754-4403-40cd-9763-93ccff4f84ce req-3cdf7682-e375-4278-8891-7ce2217093b4 service nova] Acquired lock "refresh_cache-ca9be6ac-5cac-410a-92cb-f4c295ff99d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG nova.network.neutron [req-cf43a754-4403-40cd-9763-93ccff4f84ce req-3cdf7682-e375-4278-8891-7ce2217093b4 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Refreshing network info cache for port 1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:01 user nova-compute[73476]: INFO nova.compute.manager [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Terminating instance
Aug 26 21:09:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG nova.network.neutron [req-cf43a754-4403-40cd-9763-93ccff4f84ce req-3cdf7682-e375-4278-8891-7ce2217093b4 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Updated VIF entry in instance network info cache for port 1726da42-d0d1-4bd9-9928-5b157efd1e26. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG nova.network.neutron [req-cf43a754-4403-40cd-9763-93ccff4f84ce req-3cdf7682-e375-4278-8891-7ce2217093b4 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Updating instance_info_cache with network_info: [{"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-cf43a754-4403-40cd-9763-93ccff4f84ce req-3cdf7682-e375-4278-8891-7ce2217093b4 service nova] Releasing lock "refresh_cache-ca9be6ac-5cac-410a-92cb-f4c295ff99d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:02 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Instance destroyed successfully.
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.objects.instance [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lazy-loading 'resources' on Instance uuid 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T20:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-224101394',display_name='tempest-ServersNegativeTestJSON-server-224101394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-224101394',id=36,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8898a711cbc44ce3927e58efdcc04106',ramdisk_id='',reservation_id='r-x9tp39vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-969438150',owner_user_name='tempest-ServersNegativeTestJSON-969438150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:00:02Z,user_data=None,user_id='6561f885aedc4f3babc29d0d887cebf6',uuid=2ccfbf89-2c87-499b-b7c6-a8fd656cde37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converting VIF {"id": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "address": "fa:16:3e:c7:3e:6f", "network": {"id": "c62c7e92-8cb1-4841-ac33-18ab2bb82f4f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1308910841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8898a711cbc44ce3927e58efdcc04106", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa96839e2-3a", "ovs_interfaceid": "a96839e2-3a98-474c-801b-4fceb2bd2c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:3e:6f,bridge_name='br-int',has_traffic_filtering=True,id=a96839e2-3a98-474c-801b-4fceb2bd2c56,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa96839e2-3a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG os_vif [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:3e:6f,bridge_name='br-int',has_traffic_filtering=True,id=a96839e2-3a98-474c-801b-4fceb2bd2c56,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa96839e2-3a') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa96839e2-3a, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:02 user nova-compute[73476]: INFO os_vif [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:3e:6f,bridge_name='br-int',has_traffic_filtering=True,id=a96839e2-3a98-474c-801b-4fceb2bd2c56,network=Network(c62c7e92-8cb1-4841-ac33-18ab2bb82f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa96839e2-3a')
Aug 26 21:09:02 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Deleting instance files /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37_del
Aug 26 21:09:02 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Deletion of /opt/stack/data/nova/instances/2ccfbf89-2c87-499b-b7c6-a8fd656cde37_del complete
Aug 26 21:09:02 user nova-compute[73476]: INFO nova.compute.manager [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 21:09:02 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received event network-vif-unplugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] Acquiring lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] No waiting events found dispatching network-vif-unplugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received event network-vif-unplugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received event network-vif-plugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] Acquiring lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] No waiting events found dispatching network-vif-plugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:09:02 user nova-compute[73476]: WARNING nova.compute.manager [req-d4862b57-aab2-45a9-9818-56fab60790f1 req-e23dcd0c-288d-47cc-bf72-8e62c9882678 service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received unexpected event network-vif-plugged-a96839e2-3a98-474c-801b-4fceb2bd2c56 for instance with vm_state active and task_state deleting.
Aug 26 21:09:02 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:09:02 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Took 0.52 seconds to deallocate network for instance.
Aug 26 21:09:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:03 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:09:03 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:09:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:03 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Deleted allocations for instance 2ccfbf89-2c87-499b-b7c6-a8fd656cde37
Aug 26 21:09:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-481d6d70-7565-4510-9769-ece4031e14bc tempest-ServersNegativeTestJSON-969438150 tempest-ServersNegativeTestJSON-969438150-project-member] Lock "2ccfbf89-2c87-499b-b7c6-a8fd656cde37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.897s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG os_brick.utils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7023cb-ba71-4678-9b13-18f989633dd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a2a2e3-2d61-40e1-b6bf-c9a2049a69f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fa5c0b-97c7-4f9c-8ba8-ea412c03ad0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c0d36f-9ddb-4fc1-a1c3-80e3c83fa165]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:09:04 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:09:04 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f63d98-a288-4b9a-a153-78972590f8ec]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG os_brick.utils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Updating existing volume attachment record: 6a9cdd7c-5f85-4cd2-8801-e48ff8d5568c {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:09:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-45fe11f3-3c85-458a-b246-61b6f133a76f req-01410626-fa4d-4c1c-8528-b76bbc2cabbe service nova] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Received event network-vif-deleted-a96839e2-3a98-474c-801b-4fceb2bd2c56 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-a3740744-086a-4c07-9d94-62fb08d74dec req-697dfb07-4132-4cc7-a7dd-8e42b5b8509e service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-changed-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG nova.compute.manager [req-a3740744-086a-4c07-9d94-62fb08d74dec req-697dfb07-4132-4cc7-a7dd-8e42b5b8509e service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Refreshing instance network info cache due to event network-changed-46a89aff-432c-46c9-a47f-ec64d7ba894f. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a3740744-086a-4c07-9d94-62fb08d74dec req-697dfb07-4132-4cc7-a7dd-8e42b5b8509e service nova] Acquiring lock "refresh_cache-e83b1e40-a97f-45bc-a948-3b1187feb8d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a3740744-086a-4c07-9d94-62fb08d74dec req-697dfb07-4132-4cc7-a7dd-8e42b5b8509e service nova] Acquired lock "refresh_cache-e83b1e40-a97f-45bc-a948-3b1187feb8d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG nova.network.neutron [req-a3740744-086a-4c07-9d94-62fb08d74dec req-697dfb07-4132-4cc7-a7dd-8e42b5b8509e service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Refreshing network info cache for port 46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG nova.objects.instance [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'flavor' on Instance uuid e83b1e40-a97f-45bc-a948-3b1187feb8d4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:08 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Ignoring supplied device name: /dev/vdb
Aug 26 21:09:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:08 user nova-compute[73476]: INFO nova.compute.manager [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Attaching volume 9295e0bd-43ab-4690-8dd9-71942f26fd5c to /dev/vdb
Aug 26 21:09:08 user nova-compute[73476]: DEBUG os_brick.utils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:09:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[00551e2d-d5ef-43aa-9117-f1815e986255]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd2be72-8708-4467-bfc6-dcf89f3438a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938b7ae-4bf3-4c8d-ae66-9d3e236332c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27c25c-2a58-4cba-b448-ada984025a65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:09:09 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c29efc-2362-4e55-9f48-d6cd0e656077]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG nova.network.neutron [req-a3740744-086a-4c07-9d94-62fb08d74dec req-697dfb07-4132-4cc7-a7dd-8e42b5b8509e service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Updated VIF entry in instance network info cache for port 46a89aff-432c-46c9-a47f-ec64d7ba894f. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG nova.network.neutron [req-a3740744-086a-4c07-9d94-62fb08d74dec req-697dfb07-4132-4cc7-a7dd-8e42b5b8509e service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Updating instance_info_cache with network_info: [{"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG os_brick.utils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Updating existing volume attachment record: 62ac0f8c-5d82-47ff-b549-8cbef356db4c {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:09:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a3740744-086a-4c07-9d94-62fb08d74dec req-697dfb07-4132-4cc7-a7dd-8e42b5b8509e service nova] Releasing lock "refresh_cache-e83b1e40-a97f-45bc-a948-3b1187feb8d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:09:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-a0631dab-8847-48d6-a9e2-69a44655715e req-600ce255-eb25-4437-a63d-17f4c0afdcca service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received event network-changed-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-a0631dab-8847-48d6-a9e2-69a44655715e req-600ce255-eb25-4437-a63d-17f4c0afdcca service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Refreshing instance network info cache due to event network-changed-62f3add4-5ee8-4a2c-befd-9848fbc2ad46. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a0631dab-8847-48d6-a9e2-69a44655715e req-600ce255-eb25-4437-a63d-17f4c0afdcca service nova] Acquiring lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a0631dab-8847-48d6-a9e2-69a44655715e req-600ce255-eb25-4437-a63d-17f4c0afdcca service nova] Acquired lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG nova.network.neutron [req-a0631dab-8847-48d6-a9e2-69a44655715e req-600ce255-eb25-4437-a63d-17f4c0afdcca service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Refreshing network info cache for port 62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:11 user nova-compute[73476]: INFO nova.compute.manager [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Terminating instance
Aug 26 21:09:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-750960e8-f0d2-4208-b727-9b0de62848f0 req-1aaf5732-8d09-470a-ae42-e05cff290021 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received event network-vif-unplugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-750960e8-f0d2-4208-b727-9b0de62848f0 req-1aaf5732-8d09-470a-ae42-e05cff290021 service nova] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-750960e8-f0d2-4208-b727-9b0de62848f0 req-1aaf5732-8d09-470a-ae42-e05cff290021 service nova] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-750960e8-f0d2-4208-b727-9b0de62848f0 req-1aaf5732-8d09-470a-ae42-e05cff290021 service nova] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-750960e8-f0d2-4208-b727-9b0de62848f0 req-1aaf5732-8d09-470a-ae42-e05cff290021 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] No waiting events found dispatching network-vif-unplugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-750960e8-f0d2-4208-b727-9b0de62848f0 req-1aaf5732-8d09-470a-ae42-e05cff290021 service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received event network-vif-unplugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG nova.network.neutron [req-a0631dab-8847-48d6-a9e2-69a44655715e req-600ce255-eb25-4437-a63d-17f4c0afdcca service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updated VIF entry in instance network info cache for port 62f3add4-5ee8-4a2c-befd-9848fbc2ad46. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG nova.network.neutron [req-a0631dab-8847-48d6-a9e2-69a44655715e req-600ce255-eb25-4437-a63d-17f4c0afdcca service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updating instance_info_cache with network_info: [{"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:09:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a0631dab-8847-48d6-a9e2-69a44655715e req-600ce255-eb25-4437-a63d-17f4c0afdcca service nova] Releasing lock "refresh_cache-3639bd9f-308c-4680-b18c-0720d6f18327" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:09:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Instance destroyed successfully.
Aug 26 21:09:12 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lazy-loading 'resources' on Instance uuid 3639bd9f-308c-4680-b18c-0720d6f18327 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-553883470',display_name='tempest-TestStampPattern-server-553883470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-553883470',id=39,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBJxN4wvMn8Jar6NrIBiYVMiu3vgfLkl6323Mn8p765asBJjOSbk1YLZEFjYoYJLW4VOzDi5yHEmiOk8JKFOVGKLi4tNN1pZeSYxVVQ4b/Q10+a3fyslhJc+nWG56XtGA==',key_name='tempest-TestStampPattern-1984164735',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='273b5f4f187d4443b5b2e563133b60b4',ramdisk_id='',reservation_id='r-cj60b1t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1638669422',owner_user_name='tempest-TestStampPattern-1638669422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:04:56Z,user_data=None,user_id='7600fe3f150b40b8a9905a7590aa2bf2',uuid=3639bd9f-308c-4680-b18c-0720d6f18327,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converting VIF {"id": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "address": "fa:16:3e:47:fa:70", "network": {"id": "383e07c7-b038-4b9f-82af-af1aa5387156", "bridge": "br-int", "label": "tempest-TestStampPattern-1962830825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "273b5f4f187d4443b5b2e563133b60b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f3add4-5e", "ovs_interfaceid": "62f3add4-5ee8-4a2c-befd-9848fbc2ad46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:fa:70,bridge_name='br-int',has_traffic_filtering=True,id=62f3add4-5ee8-4a2c-befd-9848fbc2ad46,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f3add4-5e') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG os_vif [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:fa:70,bridge_name='br-int',has_traffic_filtering=True,id=62f3add4-5ee8-4a2c-befd-9848fbc2ad46,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f3add4-5e') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62f3add4-5e, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:12 user nova-compute[73476]: INFO os_vif [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:fa:70,bridge_name='br-int',has_traffic_filtering=True,id=62f3add4-5ee8-4a2c-befd-9848fbc2ad46,network=Network(383e07c7-b038-4b9f-82af-af1aa5387156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f3add4-5e')
Aug 26 21:09:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Deleting instance files /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327_del
Aug 26 21:09:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Deletion of /opt/stack/data/nova/instances/3639bd9f-308c-4680-b18c-0720d6f18327_del complete
Aug 26 21:09:12 user nova-compute[73476]: INFO nova.compute.manager [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 26 21:09:12 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:09:12 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Took 0.57 seconds to deallocate network for instance.
Aug 26 21:09:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:13 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:09:13 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:09:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:13 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Deleted allocations for instance 3639bd9f-308c-4680-b18c-0720d6f18327
Aug 26 21:09:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4b7ccb94-04cd-41b3-ae45-cba6e6c9950a tempest-TestStampPattern-1638669422 tempest-TestStampPattern-1638669422-project-member] Lock "3639bd9f-308c-4680-b18c-0720d6f18327" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.066s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9eb87f16-97dc-4301-b61b-054cc055127f req-5adfc30c-fd1d-4476-8dae-c477805552cb service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received event network-vif-plugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9eb87f16-97dc-4301-b61b-054cc055127f req-5adfc30c-fd1d-4476-8dae-c477805552cb service nova] Acquiring lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9eb87f16-97dc-4301-b61b-054cc055127f req-5adfc30c-fd1d-4476-8dae-c477805552cb service nova] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9eb87f16-97dc-4301-b61b-054cc055127f req-5adfc30c-fd1d-4476-8dae-c477805552cb service nova] Lock "3639bd9f-308c-4680-b18c-0720d6f18327-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9eb87f16-97dc-4301-b61b-054cc055127f req-5adfc30c-fd1d-4476-8dae-c477805552cb service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] No waiting events found dispatching network-vif-plugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:09:13 user nova-compute[73476]: WARNING nova.compute.manager [req-9eb87f16-97dc-4301-b61b-054cc055127f req-5adfc30c-fd1d-4476-8dae-c477805552cb service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received unexpected event network-vif-plugged-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 for instance with vm_state deleted and task_state None.
Aug 26 21:09:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-9eb87f16-97dc-4301-b61b-054cc055127f req-5adfc30c-fd1d-4476-8dae-c477805552cb service nova] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Received event network-vif-deleted-62f3add4-5ee8-4a2c-befd-9848fbc2ad46 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:09:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Creating image(s)
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Ensure instance console log exists: /opt/stack/data/nova/instances/ca9be6ac-5cac-410a-92cb-f4c295ff99d4/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Start _get_guest_xml network_info=[{"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T21:08:45Z,direct_url=<?>,disk_format='qcow2',id=de5b3710-fd85-4b5d-be32-61240ad271d0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-277970071',owner='a1962b32d78d4f6da29bb0fdaa001363',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T21:08:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '6a9cdd7c-5f85-4cd2-8801-e48ff8d5568c', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKEBRhPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca9be6ac-5cac-410a-92cb-f4c295ff99d4', 'attached_at': '', 'detached_at': '', 'volume_id': '35323a66-d4ec-486d-90e5-c2b1f25d9c28', 'serial': '35323a66-d4ec-486d-90e5-c2b1f25d9c28'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:09:16 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:09:16 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T21:08:45Z,direct_url=<?>,disk_format='qcow2',id=de5b3710-fd85-4b5d-be32-61240ad271d0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-277970071',owner='a1962b32d78d4f6da29bb0fdaa001363',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T21:08:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKEBRhPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:09:16 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:09:16 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:09:16 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad55750-2577-42ab-8602-6fed83afe04f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:09:16 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b9e6f4-2b21-47ca-9a6b-71b2a81f9e18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28] added
Aug 26 21:09:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc859de-2624-44ca-9fa7-fbf0a8635ec5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[76db6cbd-879a-4499-a0f1-0004aec9a6d8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKEBRhPi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKEBRhPi" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b543be-06f0-4033-b0bb-9ec0b6a4e9e1]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kKEBRhPi'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedc2fe6-c3a0-433c-80d7-95d47dc50f61]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fbd5b4-2154-4064-b070-4f9b0530e789]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:09:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:09:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea53352-8474-478a-a0f4-809f221a224e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28, portal: 172.16.0.220,3260]
Aug 26 21:09:16 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28, portal: 172.16.0.220,3260] successful.
Aug 26 21:09:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[042a582f-e52c-45b5-a096-ec24ac615bfe]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e67f873-cc50-4a1a-afae-6a43ff3922e9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:09:16 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:09:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:09:16 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:09:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f92aee-5a37-405a-93cd-1603ba45944e]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:16 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084142.2137265, 2ccfbf89-2c87-499b-b7c6-a8fd656cde37 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:09:17 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] VM Stopped (Lifecycle Event)
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-a651b75a-4bf2-43b1-b28b-05b9c10959e4 None None] [instance: 2ccfbf89-2c87-499b-b7c6-a8fd656cde37] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKEBRhPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23732643162386438', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732643162386438', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-605552858',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-605552858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-605552858',id=46,image_ref='de5b3710-fd85-4b5d-be32-61240ad271d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgRymDcHtw7W90qNo80JEJb4o8rg/nKgjohTYjbgwQgwr3pYRa5PRi3WQb8au+RWJPHpPJPQrdv+Bu0kV1cxOmRYsMKfXPx6gCpC9jFENHtT9Do7/lJ96x2q6pa8DIupQ==',key_name='tempest-keypair-618671425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-0qdyqslb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-443030295',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=ca9be6ac-5cac-410a-92cb-f4c295ff99d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=1726da42-d0d1-4bd9-9928-5b157efd1e26,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1726da42-d0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.objects.instance [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'pci_devices' on Instance uuid ca9be6ac-5cac-410a-92cb-f4c295ff99d4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:09:17 user nova-compute[73476]:   <uuid>ca9be6ac-5cac-410a-92cb-f4c295ff99d4</uuid>
Aug 26 21:09:17 user nova-compute[73476]:   <name>instance-0000002e</name>
Aug 26 21:09:17 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:09:17 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:09:17 user nova-compute[73476]:   <metadata>
Aug 26 21:09:17 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:09:17 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:09:17 user nova-compute[73476]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-605552858</nova:name>
Aug 26 21:09:17 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:09:16</nova:creationTime>
Aug 26 21:09:17 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:09:17 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:09:17 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:09:17 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:09:17 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:09:17 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:09:17 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:09:17 user nova-compute[73476]:       <nova:owner>
Aug 26 21:09:17 user nova-compute[73476]:         <nova:user uuid="5bb1fc1180d34eb0ae98c52187aae87e">tempest-TestVolumeBootPattern-443030295-project-member</nova:user>
Aug 26 21:09:17 user nova-compute[73476]:         <nova:project uuid="a1962b32d78d4f6da29bb0fdaa001363">tempest-TestVolumeBootPattern-443030295</nova:project>
Aug 26 21:09:17 user nova-compute[73476]:       </nova:owner>
Aug 26 21:09:17 user nova-compute[73476]:       <nova:root type="image" uuid="de5b3710-fd85-4b5d-be32-61240ad271d0"/>
Aug 26 21:09:17 user nova-compute[73476]:       <nova:ports>
Aug 26 21:09:17 user nova-compute[73476]:         <nova:port uuid="1726da42-d0d1-4bd9-9928-5b157efd1e26">
Aug 26 21:09:17 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 21:09:17 user nova-compute[73476]:         </nova:port>
Aug 26 21:09:17 user nova-compute[73476]:       </nova:ports>
Aug 26 21:09:17 user nova-compute[73476]:     </nova:instance>
Aug 26 21:09:17 user nova-compute[73476]:   </metadata>
Aug 26 21:09:17 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:09:17 user nova-compute[73476]:     <system>
Aug 26 21:09:17 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:09:17 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:09:17 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:09:17 user nova-compute[73476]:       <entry name="serial">ca9be6ac-5cac-410a-92cb-f4c295ff99d4</entry>
Aug 26 21:09:17 user nova-compute[73476]:       <entry name="uuid">ca9be6ac-5cac-410a-92cb-f4c295ff99d4</entry>
Aug 26 21:09:17 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:09:17 user nova-compute[73476]:     </system>
Aug 26 21:09:17 user nova-compute[73476]:   </sysinfo>
Aug 26 21:09:17 user nova-compute[73476]:   <os>
Aug 26 21:09:17 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:09:17 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:09:17 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:09:17 user nova-compute[73476]:   </os>
Aug 26 21:09:17 user nova-compute[73476]:   <features>
Aug 26 21:09:17 user nova-compute[73476]:     <acpi/>
Aug 26 21:09:17 user nova-compute[73476]:     <apic/>
Aug 26 21:09:17 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:09:17 user nova-compute[73476]:   </features>
Aug 26 21:09:17 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:09:17 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:09:17 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:09:17 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:09:17 user nova-compute[73476]:   </clock>
Aug 26 21:09:17 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:09:17 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:09:17 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:09:17 user nova-compute[73476]:   </cpu>
Aug 26 21:09:17 user nova-compute[73476]:   <devices>
Aug 26 21:09:17 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 21:09:17 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:09:17 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 21:09:17 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:09:17 user nova-compute[73476]:       <serial>35323a66-d4ec-486d-90e5-c2b1f25d9c28</serial>
Aug 26 21:09:17 user nova-compute[73476]:     </disk>
Aug 26 21:09:17 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:09:17 user nova-compute[73476]:       <mac address="fa:16:3e:fa:d3:41"/>
Aug 26 21:09:17 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:09:17 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:09:17 user nova-compute[73476]:       <target dev="tap1726da42-d0"/>
Aug 26 21:09:17 user nova-compute[73476]:     </interface>
Aug 26 21:09:17 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:09:17 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/ca9be6ac-5cac-410a-92cb-f4c295ff99d4/console.log" append="off"/>
Aug 26 21:09:17 user nova-compute[73476]:     </serial>
Aug 26 21:09:17 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:09:17 user nova-compute[73476]:     <video>
Aug 26 21:09:17 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:09:17 user nova-compute[73476]:     </video>
Aug 26 21:09:17 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:09:17 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:09:17 user nova-compute[73476]:     </rng>
Aug 26 21:09:17 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:09:17 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:09:17 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:09:17 user nova-compute[73476]:     </memballoon>
Aug 26 21:09:17 user nova-compute[73476]:   </devices>
Aug 26 21:09:17 user nova-compute[73476]: </domain>
Aug 26 21:09:17 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-605552858',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-605552858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-605552858',id=46,image_ref='de5b3710-fd85-4b5d-be32-61240ad271d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgRymDcHtw7W90qNo80JEJb4o8rg/nKgjohTYjbgwQgwr3pYRa5PRi3WQb8au+RWJPHpPJPQrdv+Bu0kV1cxOmRYsMKfXPx6gCpC9jFENHtT9Do7/lJ96x2q6pa8DIupQ==',key_name='tempest-keypair-618671425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-0qdyqslb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-443030295',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=ca9be6ac-5cac-410a-92cb-f4c295ff99d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=1726da42-d0d1-4bd9-9928-5b157efd1e26,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1726da42-d0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG os_vif [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=1726da42-d0d1-4bd9-9928-5b157efd1e26,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1726da42-d0') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1726da42-d0, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1726da42-d0, col_values=(('external_ids', {'iface-id': '1726da42-d0d1-4bd9-9928-5b157efd1e26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:d3:41', 'vm-uuid': 'ca9be6ac-5cac-410a-92cb-f4c295ff99d4'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:17 user nova-compute[73476]: INFO os_vif [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=1726da42-d0d1-4bd9-9928-5b157efd1e26,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1726da42-d0')
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:09:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No VIF found with MAC fa:16:3e:fa:d3:41, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-644a9b5b-fcfd-4df9-8c15-1e105f219f55 req-fa364d48-c41c-4cdb-a990-945bf5d9e744 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received event network-vif-plugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-644a9b5b-fcfd-4df9-8c15-1e105f219f55 req-fa364d48-c41c-4cdb-a990-945bf5d9e744 service nova] Acquiring lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-644a9b5b-fcfd-4df9-8c15-1e105f219f55 req-fa364d48-c41c-4cdb-a990-945bf5d9e744 service nova] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-644a9b5b-fcfd-4df9-8c15-1e105f219f55 req-fa364d48-c41c-4cdb-a990-945bf5d9e744 service nova] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG nova.compute.manager [req-644a9b5b-fcfd-4df9-8c15-1e105f219f55 req-fa364d48-c41c-4cdb-a990-945bf5d9e744 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] No waiting events found dispatching network-vif-plugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:09:19 user nova-compute[73476]: WARNING nova.compute.manager [req-644a9b5b-fcfd-4df9-8c15-1e105f219f55 req-fa364d48-c41c-4cdb-a990-945bf5d9e744 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received unexpected event network-vif-plugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 for instance with vm_state building and task_state spawning.
Aug 26 21:09:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPRgycYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:09:20 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:09:20 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:09:20 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a70a99-bb34-498c-9c15-13c234eac6d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:09:20 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d8e34f-54ca-4b86-958b-ceda0aae2354]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c] added
Aug 26 21:09:20 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec0bb54-ce60-415d-9c66-e36c6283a7e2]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[430b9e2a-3ba5-4fea-8095-d79cfac13f05]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fPRgycYp {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fPRgycYp" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59e1d81-5e77-4fa5-90ae-b5359b750778]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fPRgycYp'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[038af695-f512-4432-8729-db8830e12cff]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e245a1ee-c06c-43ed-9eaa-26003ba11bff]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:09:20 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:09:20 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:09:20 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:09:20 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae42b2a8-9879-4a53-ae42-789e4d73fbef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c, portal: 172.16.0.220,3260]
Aug 26 21:09:20 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c, portal: 172.16.0.220,3260] successful.
Aug 26 21:09:20 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21e4ae0-8926-4595-aa3f-94a41013ae8f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b100ba86-7cb7-40fe-8781-a5d4eb0872ac]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:09:20 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:09:20 user nova-compute[73476]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c (non-flash)
Aug 26 21:09:20 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:09:20 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:09:20 user nova-compute[73476]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c (non-flash)
Aug 26 21:09:20 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1810404-a381-442a-9db4-2ebfe7b92383]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:09:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084161.218494, ca9be6ac-5cac-410a-92cb-f4c295ff99d4 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:09:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] VM Resumed (Lifecycle Event)
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:09:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Instance spawned successfully.
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:09:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084161.219604, ca9be6ac-5cac-410a-92cb-f4c295ff99d4 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:09:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] VM Started (Lifecycle Event)
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:09:21 user nova-compute[73476]: INFO nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:09:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-832b0153-452a-4cee-8b93-43a0569eefe5 req-826d8151-4c86-4936-a96f-565839edd8b8 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received event network-vif-plugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-832b0153-452a-4cee-8b93-43a0569eefe5 req-826d8151-4c86-4936-a96f-565839edd8b8 service nova] Acquiring lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-832b0153-452a-4cee-8b93-43a0569eefe5 req-826d8151-4c86-4936-a96f-565839edd8b8 service nova] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-832b0153-452a-4cee-8b93-43a0569eefe5 req-826d8151-4c86-4936-a96f-565839edd8b8 service nova] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-832b0153-452a-4cee-8b93-43a0569eefe5 req-826d8151-4c86-4936-a96f-565839edd8b8 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] No waiting events found dispatching network-vif-plugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:09:21 user nova-compute[73476]: WARNING nova.compute.manager [req-832b0153-452a-4cee-8b93-43a0569eefe5 req-826d8151-4c86-4936-a96f-565839edd8b8 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received unexpected event network-vif-plugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 for instance with vm_state building and task_state spawning.
Aug 26 21:09:21 user nova-compute[73476]: INFO nova.compute.manager [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Took 23.31 seconds to build instance.
Aug 26 21:09:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-4d5f989e-f10a-4dbe-ba38-1d2aa063d522 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.412s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPRgycYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23765373861353931', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765373861353931', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'flavor' on Instance uuid e83b1e40-a97f-45bc-a948-3b1187feb8d4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:09:21 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:09:21 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:09:21 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:09:21 user nova-compute[73476]:   <serial>9295e0bd-43ab-4690-8dd9-71942f26fd5c</serial>
Aug 26 21:09:21 user nova-compute[73476]: </disk>
Aug 26 21:09:21 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:09:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:09:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:09:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] No VIF found with MAC fa:16:3e:7d:37:b2, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:09:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-64bd2fc4-cc0b-4838-8556-495988016c9b tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.575s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:24 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:09:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquired lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:09:24 user nova-compute[73476]: DEBUG nova.network.neutron [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:09:24 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'info_cache' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:24 user nova-compute[73476]: DEBUG nova.objects.base [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:09:24 user nova-compute[73476]: DEBUG nova.network.neutron [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating instance_info_cache with network_info: [{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:09:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Releasing lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:09:25 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance destroyed successfully.
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'resources' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.base [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-688110644',display_name='tempest-AttachVolumeTestJSON-server-688110644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-688110644',id=38,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9LlIp4XneY32xtVLh6cIt5TSoHUqkcuD1XQ4hBSRMkm9So7JHOZP6BIojHT3q3aZ2oMpkm94dx8SqLtMc8f3ohUAvHCObRUe+gUe4wm/9E3dxtRL6BXFbzsvtqoJlbAw==',key_name='tempest-keypair-1294012772',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-uhly31gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=7d07fece-58a4-46ec-902c-f1506956d1fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG os_vif [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64288b3e-9d, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:09:25 user nova-compute[73476]: INFO os_vif [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d')
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Start _get_guest_xml network_info=[{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.base [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:09:25 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:09:25 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.base [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-688110644',display_name='tempest-AttachVolumeTestJSON-server-688110644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-688110644',id=38,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9LlIp4XneY32xtVLh6cIt5TSoHUqkcuD1XQ4hBSRMkm9So7JHOZP6BIojHT3q3aZ2oMpkm94dx8SqLtMc8f3ohUAvHCObRUe+gUe4wm/9E3dxtRL6BXFbzsvtqoJlbAw==',key_name='tempest-keypair-1294012772',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-uhly31gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=7d07fece-58a4-46ec-902c-f1506956d1fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.base [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:09:25 user nova-compute[73476]:   <uuid>7d07fece-58a4-46ec-902c-f1506956d1fa</uuid>
Aug 26 21:09:25 user nova-compute[73476]:   <name>instance-00000026</name>
Aug 26 21:09:25 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:09:25 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:09:25 user nova-compute[73476]:   <metadata>
Aug 26 21:09:25 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:09:25 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:09:25 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeTestJSON-server-688110644</nova:name>
Aug 26 21:09:25 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:09:25</nova:creationTime>
Aug 26 21:09:25 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:09:25 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:09:25 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:09:25 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:09:25 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:09:25 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:09:25 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:09:25 user nova-compute[73476]:       <nova:owner>
Aug 26 21:09:25 user nova-compute[73476]:         <nova:user uuid="4d2ff94872bd43dd8f7e4319e9e63934">tempest-AttachVolumeTestJSON-359578438-project-member</nova:user>
Aug 26 21:09:25 user nova-compute[73476]:         <nova:project uuid="3ed24e21a3624f4e8a4311728ff1c9f5">tempest-AttachVolumeTestJSON-359578438</nova:project>
Aug 26 21:09:25 user nova-compute[73476]:       </nova:owner>
Aug 26 21:09:25 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:09:25 user nova-compute[73476]:       <nova:ports>
Aug 26 21:09:25 user nova-compute[73476]:         <nova:port uuid="64288b3e-9d2a-4c14-9a96-308182a1bf4b">
Aug 26 21:09:25 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 21:09:25 user nova-compute[73476]:         </nova:port>
Aug 26 21:09:25 user nova-compute[73476]:       </nova:ports>
Aug 26 21:09:25 user nova-compute[73476]:     </nova:instance>
Aug 26 21:09:25 user nova-compute[73476]:   </metadata>
Aug 26 21:09:25 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:09:25 user nova-compute[73476]:     <system>
Aug 26 21:09:25 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:09:25 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:09:25 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:09:25 user nova-compute[73476]:       <entry name="serial">7d07fece-58a4-46ec-902c-f1506956d1fa</entry>
Aug 26 21:09:25 user nova-compute[73476]:       <entry name="uuid">7d07fece-58a4-46ec-902c-f1506956d1fa</entry>
Aug 26 21:09:25 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:09:25 user nova-compute[73476]:     </system>
Aug 26 21:09:25 user nova-compute[73476]:   </sysinfo>
Aug 26 21:09:25 user nova-compute[73476]:   <os>
Aug 26 21:09:25 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:09:25 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:09:25 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:09:25 user nova-compute[73476]:   </os>
Aug 26 21:09:25 user nova-compute[73476]:   <features>
Aug 26 21:09:25 user nova-compute[73476]:     <acpi/>
Aug 26 21:09:25 user nova-compute[73476]:     <apic/>
Aug 26 21:09:25 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:09:25 user nova-compute[73476]:   </features>
Aug 26 21:09:25 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:09:25 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:09:25 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:09:25 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:09:25 user nova-compute[73476]:   </clock>
Aug 26 21:09:25 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:09:25 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:09:25 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:09:25 user nova-compute[73476]:   </cpu>
Aug 26 21:09:25 user nova-compute[73476]:   <devices>
Aug 26 21:09:25 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:09:25 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:09:25 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk"/>
Aug 26 21:09:25 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:09:25 user nova-compute[73476]:     </disk>
Aug 26 21:09:25 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:09:25 user nova-compute[73476]:       <mac address="fa:16:3e:40:fb:89"/>
Aug 26 21:09:25 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:09:25 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:09:25 user nova-compute[73476]:       <target dev="tap64288b3e-9d"/>
Aug 26 21:09:25 user nova-compute[73476]:     </interface>
Aug 26 21:09:25 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:09:25 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/console.log" append="off"/>
Aug 26 21:09:25 user nova-compute[73476]:     </serial>
Aug 26 21:09:25 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:09:25 user nova-compute[73476]:     <video>
Aug 26 21:09:25 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:09:25 user nova-compute[73476]:     </video>
Aug 26 21:09:25 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:09:25 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:09:25 user nova-compute[73476]:     </rng>
Aug 26 21:09:25 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:09:25 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:09:25 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:09:25 user nova-compute[73476]:     </memballoon>
Aug 26 21:09:25 user nova-compute[73476]:   </devices>
Aug 26 21:09:25 user nova-compute[73476]: </domain>
Aug 26 21:09:25 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.base [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.180s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Cannot resize image /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:09:25 user nova-compute[73476]: DEBUG nova.objects.instance [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'migration_context' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG nova.objects.base [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Object Instance<7d07fece-58a4-46ec-902c-f1506956d1fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73476) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-688110644',display_name='tempest-AttachVolumeTestJSON-server-688110644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-688110644',id=38,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9LlIp4XneY32xtVLh6cIt5TSoHUqkcuD1XQ4hBSRMkm9So7JHOZP6BIojHT3q3aZ2oMpkm94dx8SqLtMc8f3ohUAvHCObRUe+gUe4wm/9E3dxtRL6BXFbzsvtqoJlbAw==',key_name='tempest-keypair-1294012772',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-uhly31gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=7d07fece-58a4-46ec-902c-f1506956d1fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG os_vif [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64288b3e-9d, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64288b3e-9d, col_values=(('external_ids', {'iface-id': '64288b3e-9d2a-4c14-9a96-308182a1bf4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:fb:89', 'vm-uuid': '7d07fece-58a4-46ec-902c-f1506956d1fa'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:09:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:26 user nova-compute[73476]: INFO os_vif [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d')
Aug 26 21:09:27 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084152.154937, 3639bd9f-308c-4680-b18c-0720d6f18327 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:09:27 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] VM Stopped (Lifecycle Event)
Aug 26 21:09:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-5822f5bf-d529-4db3-81d4-70b902a7e37a None None] [instance: 3639bd9f-308c-4680-b18c-0720d6f18327] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:09:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-fd72f9f7-5b07-4528-9fcc-c65e7c446819 req-7b59256e-1f08-481a-9601-d30ccf5b8acd service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fd72f9f7-5b07-4528-9fcc-c65e7c446819 req-7b59256e-1f08-481a-9601-d30ccf5b8acd service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fd72f9f7-5b07-4528-9fcc-c65e7c446819 req-7b59256e-1f08-481a-9601-d30ccf5b8acd service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:27 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fd72f9f7-5b07-4528-9fcc-c65e7c446819 req-7b59256e-1f08-481a-9601-d30ccf5b8acd service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:27 user nova-compute[73476]: DEBUG nova.compute.manager [req-fd72f9f7-5b07-4528-9fcc-c65e7c446819 req-7b59256e-1f08-481a-9601-d30ccf5b8acd service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:09:27 user nova-compute[73476]: WARNING nova.compute.manager [req-fd72f9f7-5b07-4528-9fcc-c65e7c446819 req-7b59256e-1f08-481a-9601-d30ccf5b8acd service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state stopped and task_state powering-on.
Aug 26 21:09:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:28 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084169.5431252, 7d07fece-58a4-46ec-902c-f1506956d1fa => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:09:29 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] VM Resumed (Lifecycle Event)
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:09:29 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance rebooted successfully.
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-63037a4f-bd2b-4550-aad9-6c31481ab581 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:09:29 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084169.5447857, 7d07fece-58a4-46ec-902c-f1506956d1fa => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:09:29 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] VM Started (Lifecycle Event)
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-b99ee876-26e8-4fff-ac8b-8b73431a8985 req-5388c89b-6ca4-469f-afdd-a52d248c370f service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:09:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b99ee876-26e8-4fff-ac8b-8b73431a8985 req-5388c89b-6ca4-469f-afdd-a52d248c370f service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b99ee876-26e8-4fff-ac8b-8b73431a8985 req-5388c89b-6ca4-469f-afdd-a52d248c370f service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:29 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b99ee876-26e8-4fff-ac8b-8b73431a8985 req-5388c89b-6ca4-469f-afdd-a52d248c370f service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:29 user nova-compute[73476]: DEBUG nova.compute.manager [req-b99ee876-26e8-4fff-ac8b-8b73431a8985 req-5388c89b-6ca4-469f-afdd-a52d248c370f service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:09:29 user nova-compute[73476]: WARNING nova.compute.manager [req-b99ee876-26e8-4fff-ac8b-8b73431a8985 req-5388c89b-6ca4-469f-afdd-a52d248c370f service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state active and task_state None.
Aug 26 21:09:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:44 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:09:44 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:09:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:09:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:09:48 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:09:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:09:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:09:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:54 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:09:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:09:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:09:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:09:54 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating instance_info_cache with network_info: [{"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-7d07fece-58a4-46ec-902c-f1506956d1fa" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:09:56 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:09:56 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:09:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8197MB free_disk=25.134986877441406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance a106a9ab-407a-49b1-99fd-6406b89e065c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance e83b1e40-a97f-45bc-a948-3b1187feb8d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance ca9be6ac-5cac-410a-92cb-f4c295ff99d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:09:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:09:57 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:09:57 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:09:57 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:09:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:10:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:10:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:09 user nova-compute[73476]: INFO nova.compute.manager [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Detaching volume 9295e0bd-43ab-4690-8dd9-71942f26fd5c
Aug 26 21:10:09 user nova-compute[73476]: INFO nova.virt.block_device [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Attempting to driver detach volume 9295e0bd-43ab-4690-8dd9-71942f26fd5c from mountpoint /dev/vdb
Aug 26 21:10:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Attempting to detach device vdb from instance e83b1e40-a97f-45bc-a948-3b1187feb8d4 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:10:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:10:09 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:10:09 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:10:09 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:10:09 user nova-compute[73476]:   <serial>9295e0bd-43ab-4690-8dd9-71942f26fd5c</serial>
Aug 26 21:10:09 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:10:09 user nova-compute[73476]: </disk>
Aug 26 21:10:09 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:10:09 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Successfully detached device vdb from instance e83b1e40-a97f-45bc-a948-3b1187feb8d4 from the persistent domain config.
Aug 26 21:10:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e83b1e40-a97f-45bc-a948-3b1187feb8d4 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:10:09 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:10:09 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:10:09 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:10:09 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:10:09 user nova-compute[73476]:   <serial>9295e0bd-43ab-4690-8dd9-71942f26fd5c</serial>
Aug 26 21:10:09 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:10:09 user nova-compute[73476]: </disk>
Aug 26 21:10:09 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:10:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693084210.0176983, e83b1e40-a97f-45bc-a948-3b1187feb8d4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e83b1e40-a97f-45bc-a948-3b1187feb8d4 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:10:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Successfully detached device vdb from instance e83b1e40-a97f-45bc-a948-3b1187feb8d4 from the live domain config.
Aug 26 21:10:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPRgycYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:10:10 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f37c95d-51b7-419b-b5a7-03c2cbbd79df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d89e14-b1fb-442e-9567-b06b5d421a66]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:10:10 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:10:10 user nova-compute[73476]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c (non-flash)
Aug 26 21:10:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:10:10 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:10:10 user nova-compute[73476]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c (non-flash)
Aug 26 21:10:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d0408160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c514ab7-db89-4f45-b06b-2f320494d07b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aa8340-1b91-447c-847f-9eae6e4463d7]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b125d4e-e931-4b0c-9b53-b79572e22165]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[44742be7-c6d4-4005-a737-d403edfe42d7]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dd042f-41a2-4ee4-8c91-8357b8f32fa8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d936b4-f15a-4f3f-a24d-29e2da4d15ae]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c, portal: 172.16.0.220,3260]
Aug 26 21:10:10 user nova-compute[73476]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c, portal: 172.16.0.220,3260] successful.
Aug 26 21:10:10 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc255e9-a747-41ab-9d16-7bfd1c70e196]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] <== disconnect_volume: return (309ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:10:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'flavor' on Instance uuid e83b1e40-a97f-45bc-a948-3b1187feb8d4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9cad7ffb-5427-4e02-8d8b-e560609aeb06 tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.869s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.724s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:11 user nova-compute[73476]: INFO nova.compute.manager [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Terminating instance
Aug 26 21:10:11 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-1c0e3f08-e8ad-41ef-9241-69eeca990a38 req-757bbb63-f083-4e84-ab9c-871472a69005 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-unplugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1c0e3f08-e8ad-41ef-9241-69eeca990a38 req-757bbb63-f083-4e84-ab9c-871472a69005 service nova] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1c0e3f08-e8ad-41ef-9241-69eeca990a38 req-757bbb63-f083-4e84-ab9c-871472a69005 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1c0e3f08-e8ad-41ef-9241-69eeca990a38 req-757bbb63-f083-4e84-ab9c-871472a69005 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-1c0e3f08-e8ad-41ef-9241-69eeca990a38 req-757bbb63-f083-4e84-ab9c-871472a69005 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] No waiting events found dispatching network-vif-unplugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG nova.compute.manager [req-1c0e3f08-e8ad-41ef-9241-69eeca990a38 req-757bbb63-f083-4e84-ab9c-871472a69005 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-unplugged-46a89aff-432c-46c9-a47f-ec64d7ba894f for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:10:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Instance destroyed successfully.
Aug 26 21:10:12 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lazy-loading 'resources' on Instance uuid e83b1e40-a97f-45bc-a948-3b1187feb8d4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1436531964',display_name='tempest-VolumesSnapshotTestJSON-instance-1436531964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1436531964',id=45,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyKxWsek03dkRlpmsnl0JaL2McUEQ7LoPjkWevirLEnW9RX1yR2Vqe6quOtVkdzjlN7gKHpSnZ/Z/aFcUHLk50ZUnZg/MMbretW6a8coleZ6xodPBmhRHwYkdethXDCRQ==',key_name='tempest-keypair-1252023387',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:07:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b84b4dda8794d89a3b826169d3622ae',ramdisk_id='',reservation_id='r-w7r37cew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1103521950',owner_user_name='tempest-VolumesSnapshotTestJSON-1103521950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9fdaeb7bcc6482e87bb4b9757c5ff94',uuid=e83b1e40-a97f-45bc-a948-3b1187feb8d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converting VIF {"id": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "address": "fa:16:3e:7d:37:b2", "network": {"id": "94b223fe-53eb-4fca-8697-4ac6590b0781", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1679395378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b84b4dda8794d89a3b826169d3622ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a89aff-43", "ovs_interfaceid": "46a89aff-432c-46c9-a47f-ec64d7ba894f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:37:b2,bridge_name='br-int',has_traffic_filtering=True,id=46a89aff-432c-46c9-a47f-ec64d7ba894f,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a89aff-43') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_vif [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:37:b2,bridge_name='br-int',has_traffic_filtering=True,id=46a89aff-432c-46c9-a47f-ec64d7ba894f,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a89aff-43') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46a89aff-43, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: INFO os_vif [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:37:b2,bridge_name='br-int',has_traffic_filtering=True,id=46a89aff-432c-46c9-a47f-ec64d7ba894f,network=Network(94b223fe-53eb-4fca-8697-4ac6590b0781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a89aff-43')
Aug 26 21:10:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPRgycYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:10:12 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9295e0bd-43ab-4690-8dd9-71942f26fd5c', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0b8ce6-6d47-4400-b7c8-7723c6b57abd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2820c3-66cf-4176-b058-7f8325c4c53f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:10:12 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:10:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:10:12 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:10:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b01260e0>, {}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Disconnecting from: [] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] <== disconnect_volume: return (62ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:10:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Deleting instance files /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4_del
Aug 26 21:10:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Deletion of /opt/stack/data/nova/instances/e83b1e40-a97f-45bc-a948-3b1187feb8d4_del complete
Aug 26 21:10:12 user nova-compute[73476]: INFO nova.compute.manager [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 26 21:10:12 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] No waiting events found dispatching network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:10:13 user nova-compute[73476]: WARNING nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received unexpected event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f for instance with vm_state active and task_state deleting.
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] No waiting events found dispatching network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:10:13 user nova-compute[73476]: WARNING nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received unexpected event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f for instance with vm_state active and task_state deleting.
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] No waiting events found dispatching network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:10:13 user nova-compute[73476]: WARNING nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received unexpected event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f for instance with vm_state active and task_state deleting.
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-unplugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] No waiting events found dispatching network-vif-unplugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-unplugged-46a89aff-432c-46c9-a47f-ec64d7ba894f for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Acquiring lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:13 user nova-compute[73476]: DEBUG nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] No waiting events found dispatching network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:10:13 user nova-compute[73476]: WARNING nova.compute.manager [req-700c40c9-dcfd-416d-86fc-4502686c2bef req-1f795e13-9aa3-4373-b5d8-5035a0ba6696 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received unexpected event network-vif-plugged-46a89aff-432c-46c9-a47f-ec64d7ba894f for instance with vm_state active and task_state deleting.
Aug 26 21:10:14 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:10:14 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Took 1.76 seconds to deallocate network for instance.
Aug 26 21:10:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-f9268a66-0033-4c81-abbf-c83c3880a6c4 req-7daef1dc-de8f-4d01-b947-58619c54b869 service nova] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Received event network-vif-deleted-46a89aff-432c-46c9-a47f-ec64d7ba894f {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:14 user nova-compute[73476]: WARNING nova.volume.cinder [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Attachment 62ac0f8c-5d82-47ff-b549-8cbef356db4c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 62ac0f8c-5d82-47ff-b549-8cbef356db4c. (HTTP 404) (Request-ID: req-35699a23-4204-4c47-b9f7-21c4495ad128)
Aug 26 21:10:14 user nova-compute[73476]: INFO nova.compute.manager [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Took 0.04 seconds to detach 1 volumes for instance.
Aug 26 21:10:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:14 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:10:14 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:10:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:14 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Deleted allocations for instance e83b1e40-a97f-45bc-a948-3b1187feb8d4
Aug 26 21:10:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f678ee79-58ef-4ed7-9a91-aeba2b6ed3ce tempest-VolumesSnapshotTestJSON-1103521950 tempest-VolumesSnapshotTestJSON-1103521950-project-member] Lock "e83b1e40-a97f-45bc-a948-3b1187feb8d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.449s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:27 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084212.0591207, e83b1e40-a97f-45bc-a948-3b1187feb8d4 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:10:27 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] VM Stopped (Lifecycle Event)
Aug 26 21:10:27 user nova-compute[73476]: DEBUG nova.compute.manager [None req-453ccb62-bafe-4171-9bb1-4efb660910de None None] [instance: e83b1e40-a97f-45bc-a948-3b1187feb8d4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:10:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:45 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:10:45 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:10:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:10:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-15c9af2d-2550-4dd9-8467-164e09d95ca8 req-c15f965b-e1b3-4fbf-8a70-e2a3131e6235 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received event network-changed-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-15c9af2d-2550-4dd9-8467-164e09d95ca8 req-c15f965b-e1b3-4fbf-8a70-e2a3131e6235 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Refreshing instance network info cache due to event network-changed-1726da42-d0d1-4bd9-9928-5b157efd1e26. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-15c9af2d-2550-4dd9-8467-164e09d95ca8 req-c15f965b-e1b3-4fbf-8a70-e2a3131e6235 service nova] Acquiring lock "refresh_cache-ca9be6ac-5cac-410a-92cb-f4c295ff99d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-15c9af2d-2550-4dd9-8467-164e09d95ca8 req-c15f965b-e1b3-4fbf-8a70-e2a3131e6235 service nova] Acquired lock "refresh_cache-ca9be6ac-5cac-410a-92cb-f4c295ff99d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-15c9af2d-2550-4dd9-8467-164e09d95ca8 req-c15f965b-e1b3-4fbf-8a70-e2a3131e6235 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Refreshing network info cache for port 1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:49 user nova-compute[73476]: INFO nova.compute.manager [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Terminating instance
Aug 26 21:10:49 user nova-compute[73476]: DEBUG nova.compute.manager [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-15c9af2d-2550-4dd9-8467-164e09d95ca8 req-c15f965b-e1b3-4fbf-8a70-e2a3131e6235 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Updated VIF entry in instance network info cache for port 1726da42-d0d1-4bd9-9928-5b157efd1e26. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-15c9af2d-2550-4dd9-8467-164e09d95ca8 req-c15f965b-e1b3-4fbf-8a70-e2a3131e6235 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Updating instance_info_cache with network_info: [{"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-15c9af2d-2550-4dd9-8467-164e09d95ca8 req-c15f965b-e1b3-4fbf-8a70-e2a3131e6235 service nova] Releasing lock "refresh_cache-ca9be6ac-5cac-410a-92cb-f4c295ff99d4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-a604b9e4-f118-41f5-b8a5-14c278dfd585 req-ae515186-5c77-4a80-a5c4-c7a7744f5b7e service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received event network-vif-unplugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a604b9e4-f118-41f5-b8a5-14c278dfd585 req-ae515186-5c77-4a80-a5c4-c7a7744f5b7e service nova] Acquiring lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a604b9e4-f118-41f5-b8a5-14c278dfd585 req-ae515186-5c77-4a80-a5c4-c7a7744f5b7e service nova] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-a604b9e4-f118-41f5-b8a5-14c278dfd585 req-ae515186-5c77-4a80-a5c4-c7a7744f5b7e service nova] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-a604b9e4-f118-41f5-b8a5-14c278dfd585 req-ae515186-5c77-4a80-a5c4-c7a7744f5b7e service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] No waiting events found dispatching network-vif-unplugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-a604b9e4-f118-41f5-b8a5-14c278dfd585 req-ae515186-5c77-4a80-a5c4-c7a7744f5b7e service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received event network-vif-unplugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:10:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Instance destroyed successfully.
Aug 26 21:10:50 user nova-compute[73476]: DEBUG nova.objects.instance [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'resources' on Instance uuid ca9be6ac-5cac-410a-92cb-f4c295ff99d4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-605552858',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-605552858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-605552858',id=46,image_ref='de5b3710-fd85-4b5d-be32-61240ad271d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgRymDcHtw7W90qNo80JEJb4o8rg/nKgjohTYjbgwQgwr3pYRa5PRi3WQb8au+RWJPHpPJPQrdv+Bu0kV1cxOmRYsMKfXPx6gCpC9jFENHtT9Do7/lJ96x2q6pa8DIupQ==',key_name='tempest-keypair-618671425',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:09:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-0qdyqslb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-443030295',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=ca9be6ac-5cac-410a-92cb-f4c295ff99d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "address": "fa:16:3e:fa:d3:41", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1726da42-d0", "ovs_interfaceid": "1726da42-d0d1-4bd9-9928-5b157efd1e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=1726da42-d0d1-4bd9-9928-5b157efd1e26,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1726da42-d0') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_vif [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=1726da42-d0d1-4bd9-9928-5b157efd1e26,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1726da42-d0') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1726da42-d0, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:50 user nova-compute[73476]: INFO os_vif [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:d3:41,bridge_name='br-int',has_traffic_filtering=True,id=1726da42-d0d1-4bd9-9928-5b157efd1e26,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1726da42-d0')
Aug 26 21:10:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKEBRhPi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:10:50 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c292bafc-8bf7-42f7-a68a-33fc8ccadb61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba7b6e5-e5dd-4409-afb6-e17a02347c69]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:10:50 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:10:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:10:50 user nova-compute[73476]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 (non-flash)
Aug 26 21:10:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258cfc4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5112b50-837e-4f5b-b32a-e7cf7ff8a071]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6949fb2-03e6-4b19-96fa-697a809a4ac0]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8959cd3b-30d9-4e97-8765-89fcc7c8d64a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0721c-b0ff-44de-9a3f-75b1d822afbd]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecca12b8-6f00-4426-9eb4-51d95c113fa4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1822646-a59e-4969-a98a-4873292afdaa]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28, portal: 172.16.0.220,3260]
Aug 26 21:10:50 user nova-compute[73476]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28, portal: 172.16.0.220,3260] successful.
Aug 26 21:10:50 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35323a66-d4ec-486d-90e5-c2b1f25d9c28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a2f585-883a-43c8-92f8-60b88247e4de]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== disconnect_volume: return (283ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:10:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Deleting instance files /opt/stack/data/nova/instances/ca9be6ac-5cac-410a-92cb-f4c295ff99d4_del
Aug 26 21:10:50 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Deletion of /opt/stack/data/nova/instances/ca9be6ac-5cac-410a-92cb-f4c295ff99d4_del complete
Aug 26 21:10:50 user nova-compute[73476]: INFO nova.compute.manager [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 26 21:10:50 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:10:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:51 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:10:51 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Took 0.87 seconds to deallocate network for instance.
Aug 26 21:10:51 user nova-compute[73476]: DEBUG nova.compute.manager [req-19d2554f-be37-4c9b-af6b-bc3142f496b2 req-7095c89b-2cf7-4fec-8efa-8851c5e6e8b1 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received event network-vif-deleted-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ead18ae-8e00-4144-821c-57c74f62d471 req-f87d078e-f32a-4a34-a8a2-577b3bcb75c6 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received event network-vif-plugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ead18ae-8e00-4144-821c-57c74f62d471 req-f87d078e-f32a-4a34-a8a2-577b3bcb75c6 service nova] Acquiring lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ead18ae-8e00-4144-821c-57c74f62d471 req-f87d078e-f32a-4a34-a8a2-577b3bcb75c6 service nova] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ead18ae-8e00-4144-821c-57c74f62d471 req-f87d078e-f32a-4a34-a8a2-577b3bcb75c6 service nova] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ead18ae-8e00-4144-821c-57c74f62d471 req-f87d078e-f32a-4a34-a8a2-577b3bcb75c6 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] No waiting events found dispatching network-vif-plugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:10:52 user nova-compute[73476]: WARNING nova.compute.manager [req-9ead18ae-8e00-4144-821c-57c74f62d471 req-f87d078e-f32a-4a34-a8a2-577b3bcb75c6 service nova] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Received unexpected event network-vif-plugged-1726da42-d0d1-4bd9-9928-5b157efd1e26 for instance with vm_state active and task_state deleting.
Aug 26 21:10:52 user nova-compute[73476]: INFO nova.compute.manager [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Took 0.80 seconds to detach 1 volumes for instance.
Aug 26 21:10:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Deleting volume: 35323a66-d4ec-486d-90e5-c2b1f25d9c28 {{(pid=73476) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:10:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:52 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Deleted allocations for instance ca9be6ac-5cac-410a-92cb-f4c295ff99d4
Aug 26 21:10:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-603a43a7-c8dc-4a16-9473-a95fd2e051b8 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "ca9be6ac-5cac-410a-92cb-f4c295ff99d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.225s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:10:55 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:10:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:55 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:10:55 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:10:56 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:10:56 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:10:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=25.15911865234375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 7d07fece-58a4-46ec-902c-f1506956d1fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance a106a9ab-407a-49b1-99fd-6406b89e065c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:10:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:10:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:10:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:10:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:10:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:10:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:10:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updating instance_info_cache with network_info: [{"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:10:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-a106a9ab-407a-49b1-99fd-6406b89e065c" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:10:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:11:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:01 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:05 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084250.4038556, ca9be6ac-5cac-410a-92cb-f4c295ff99d4 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:11:05 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] VM Stopped (Lifecycle Event)
Aug 26 21:11:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-13d9e338-7a06-41f7-9075-d77d2842181a None None] [instance: ca9be6ac-5cac-410a-92cb-f4c295ff99d4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:11:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:15 user nova-compute[73476]: INFO nova.compute.manager [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Terminating instance
Aug 26 21:11:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-b64dae1a-d547-41b2-8e1b-671d54ea216c req-80c4b0c5-6b96-46cf-8117-45bd7b48d644 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-unplugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b64dae1a-d547-41b2-8e1b-671d54ea216c req-80c4b0c5-6b96-46cf-8117-45bd7b48d644 service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b64dae1a-d547-41b2-8e1b-671d54ea216c req-80c4b0c5-6b96-46cf-8117-45bd7b48d644 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b64dae1a-d547-41b2-8e1b-671d54ea216c req-80c4b0c5-6b96-46cf-8117-45bd7b48d644 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-b64dae1a-d547-41b2-8e1b-671d54ea216c req-80c4b0c5-6b96-46cf-8117-45bd7b48d644 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-unplugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:11:15 user nova-compute[73476]: DEBUG nova.compute.manager [req-b64dae1a-d547-41b2-8e1b-671d54ea216c req-80c4b0c5-6b96-46cf-8117-45bd7b48d644 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-unplugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Instance destroyed successfully.
Aug 26 21:11:16 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'resources' on Instance uuid 7d07fece-58a4-46ec-902c-f1506956d1fa {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-688110644',display_name='tempest-AttachVolumeTestJSON-server-688110644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-688110644',id=38,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9LlIp4XneY32xtVLh6cIt5TSoHUqkcuD1XQ4hBSRMkm9So7JHOZP6BIojHT3q3aZ2oMpkm94dx8SqLtMc8f3ohUAvHCObRUe+gUe4wm/9E3dxtRL6BXFbzsvtqoJlbAw==',key_name='tempest-keypair-1294012772',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-uhly31gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=7d07fece-58a4-46ec-902c-f1506956d1fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "address": "fa:16:3e:40:fb:89", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64288b3e-9d", "ovs_interfaceid": "64288b3e-9d2a-4c14-9a96-308182a1bf4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG os_vif [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64288b3e-9d, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:11:16 user nova-compute[73476]: INFO os_vif [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:fb:89,bridge_name='br-int',has_traffic_filtering=True,id=64288b3e-9d2a-4c14-9a96-308182a1bf4b,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64288b3e-9d')
Aug 26 21:11:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Deleting instance files /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa_del
Aug 26 21:11:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Deletion of /opt/stack/data/nova/instances/7d07fece-58a4-46ec-902c-f1506956d1fa_del complete
Aug 26 21:11:16 user nova-compute[73476]: INFO nova.compute.manager [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 21:11:16 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:11:16 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:11:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-8cede07e-bb25-4c19-85a6-78d6c9b0442a req-e59f3686-b0e3-40c9-88ef-2e455102a9e1 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:11:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8cede07e-bb25-4c19-85a6-78d6c9b0442a req-e59f3686-b0e3-40c9-88ef-2e455102a9e1 service nova] Acquiring lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8cede07e-bb25-4c19-85a6-78d6c9b0442a req-e59f3686-b0e3-40c9-88ef-2e455102a9e1 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:17 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-8cede07e-bb25-4c19-85a6-78d6c9b0442a req-e59f3686-b0e3-40c9-88ef-2e455102a9e1 service nova] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:17 user nova-compute[73476]: DEBUG nova.compute.manager [req-8cede07e-bb25-4c19-85a6-78d6c9b0442a req-e59f3686-b0e3-40c9-88ef-2e455102a9e1 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] No waiting events found dispatching network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:11:17 user nova-compute[73476]: WARNING nova.compute.manager [req-8cede07e-bb25-4c19-85a6-78d6c9b0442a req-e59f3686-b0e3-40c9-88ef-2e455102a9e1 service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received unexpected event network-vif-plugged-64288b3e-9d2a-4c14-9a96-308182a1bf4b for instance with vm_state active and task_state deleting.
Aug 26 21:11:18 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:11:18 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Took 1.63 seconds to deallocate network for instance.
Aug 26 21:11:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:18 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:11:18 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:11:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:18 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Deleted allocations for instance 7d07fece-58a4-46ec-902c-f1506956d1fa
Aug 26 21:11:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7c8ddc74-fa35-4684-84a3-e7da651d3057 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "7d07fece-58a4-46ec-902c-f1506956d1fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.936s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-d8d1c6a2-feb5-465f-9e13-99dfc7584d3f req-fe883b0d-b919-4cca-8658-c6f4ac41302a service nova] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Received event network-vif-deleted-64288b3e-9d2a-4c14-9a96-308182a1bf4b {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:11:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:31 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084276.4003363, 7d07fece-58a4-46ec-902c-f1506956d1fa => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:11:31 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] VM Stopped (Lifecycle Event)
Aug 26 21:11:31 user nova-compute[73476]: DEBUG nova.compute.manager [None req-85005aa0-6644-42de-8326-7cd626037349 None None] [instance: 7d07fece-58a4-46ec-902c-f1506956d1fa] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:11:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:11:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:11:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:11:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:11:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:11:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "a106a9ab-407a-49b1-99fd-6406b89e065c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:47 user nova-compute[73476]: INFO nova.compute.manager [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Terminating instance
Aug 26 21:11:47 user nova-compute[73476]: DEBUG nova.compute.manager [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-b10564f4-6e36-4e34-ae16-a32428ba8f16 req-c7d1203f-930a-479f-a49a-e2c81fb62428 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received event network-vif-unplugged-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b10564f4-6e36-4e34-ae16-a32428ba8f16 req-c7d1203f-930a-479f-a49a-e2c81fb62428 service nova] Acquiring lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b10564f4-6e36-4e34-ae16-a32428ba8f16 req-c7d1203f-930a-479f-a49a-e2c81fb62428 service nova] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b10564f4-6e36-4e34-ae16-a32428ba8f16 req-c7d1203f-930a-479f-a49a-e2c81fb62428 service nova] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-b10564f4-6e36-4e34-ae16-a32428ba8f16 req-c7d1203f-930a-479f-a49a-e2c81fb62428 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] No waiting events found dispatching network-vif-unplugged-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-b10564f4-6e36-4e34-ae16-a32428ba8f16 req-c7d1203f-930a-479f-a49a-e2c81fb62428 service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received event network-vif-unplugged-fd56409a-6505-48f2-95d2-8d0162ad28af for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Instance destroyed successfully.
Aug 26 21:11:48 user nova-compute[73476]: DEBUG nova.objects.instance [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'resources' on Instance uuid a106a9ab-407a-49b1-99fd-6406b89e065c {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-660909955',display_name='tempest-TestVolumeBootPattern-volume-backed-server-660909955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-660909955',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8vTZ7aRjlRJjU/l38wXc/lVUoh7D0ffTRruAL/XTRhWVAU/9JC0lVjWXgo3cexyEymfQP7JomD8l0d1P/p2PXazFF+bySic+M2u+v53jRHeMOz2OknztJrOVZPXA9tkA==',key_name='tempest-keypair-1638033829',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:07:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-lmqpczvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:07:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=a106a9ab-407a-49b1-99fd-6406b89e065c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "fd56409a-6505-48f2-95d2-8d0162ad28af", "address": "fa:16:3e:88:01:48", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56409a-65", "ovs_interfaceid": "fd56409a-6505-48f2-95d2-8d0162ad28af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:01:48,bridge_name='br-int',has_traffic_filtering=True,id=fd56409a-6505-48f2-95d2-8d0162ad28af,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56409a-65') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_vif [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:01:48,bridge_name='br-int',has_traffic_filtering=True,id=fd56409a-6505-48f2-95d2-8d0162ad28af,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56409a-65') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd56409a-65, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:11:48 user nova-compute[73476]: INFO os_vif [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:01:48,bridge_name='br-int',has_traffic_filtering=True,id=fd56409a-6505-48f2-95d2-8d0162ad28af,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56409a-65')
Aug 26 21:11:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NfHSJWBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:11:48 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b6805-e5c3-4789-8642-fbf9ee61c15a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0279d42-3561-4881-bfd4-7bf8f3a1c71f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:11:48 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c (non-flash)
Aug 26 21:11:48 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b01eb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c'): ({'sdd'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Removing single pathed devices sdd {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b67ef2f-e971-4d89-b410-9bd7b03fc78b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3e50cb-8188-41f0-99d6-03a029e4763c]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flushing IO for device /dev/sdd {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.078s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc05a82-2f40-4e6f-a5b3-870a8f161d2e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[170c2371-c37c-4096-a766-84b8c9d5bd55]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO820d181a-9b8b60d2454ede96', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_820d181a', '/dev/disk/by-id/scsi-23962386236306432') {{(pid=84820) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0495e30-843c-42f5-a149-9497c8248ec2]: (4, None) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9153a1-f15e-4dc2-a08d-843888162ff9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[17775ab6-ffb7-4c13-9a7f-3f978e4e94dd]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c, portal: 172.16.0.220,3260]
Aug 26 21:11:48 user nova-compute[73476]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c, portal: 172.16.0.220,3260] successful.
Aug 26 21:11:48 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bb0c52-e50e-4105-8056-d750ce6bab6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[39866cf9-0419-4d1d-b8e6-1d7887a332fb]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== disconnect_volume: return (387ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:11:48 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:11:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Deleting instance files /opt/stack/data/nova/instances/a106a9ab-407a-49b1-99fd-6406b89e065c_del
Aug 26 21:11:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Deletion of /opt/stack/data/nova/instances/a106a9ab-407a-49b1-99fd-6406b89e065c_del complete
Aug 26 21:11:49 user nova-compute[73476]: INFO nova.compute.manager [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 26 21:11:49 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:11:49 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:11:49 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:11:49 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:49 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:11:49 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Took 0.82 seconds to deallocate network for instance.
Aug 26 21:11:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-cbf7e25c-f1f7-4350-b99e-65537c3eb702 req-7b9da060-8ef6-47f4-8d9f-6a87ca412f0f service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received event network-vif-deleted-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:11:49 user nova-compute[73476]: INFO nova.compute.manager [req-cbf7e25c-f1f7-4350-b99e-65537c3eb702 req-7b9da060-8ef6-47f4-8d9f-6a87ca412f0f service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Neutron deleted interface fd56409a-6505-48f2-95d2-8d0162ad28af; detaching it from the instance and deleting it from the info cache
Aug 26 21:11:49 user nova-compute[73476]: DEBUG nova.network.neutron [req-cbf7e25c-f1f7-4350-b99e-65537c3eb702 req-7b9da060-8ef6-47f4-8d9f-6a87ca412f0f service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:11:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-cbf7e25c-f1f7-4350-b99e-65537c3eb702 req-7b9da060-8ef6-47f4-8d9f-6a87ca412f0f service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Detach interface failed, port_id=fd56409a-6505-48f2-95d2-8d0162ad28af, reason: Instance a106a9ab-407a-49b1-99fd-6406b89e065c could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 21:11:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-5bc18003-92f5-4c09-929e-d1fcf3384900 req-6fe3d605-145d-4ce0-a857-93f754f0e10e service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received event network-vif-plugged-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:11:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5bc18003-92f5-4c09-929e-d1fcf3384900 req-6fe3d605-145d-4ce0-a857-93f754f0e10e service nova] Acquiring lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5bc18003-92f5-4c09-929e-d1fcf3384900 req-6fe3d605-145d-4ce0-a857-93f754f0e10e service nova] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5bc18003-92f5-4c09-929e-d1fcf3384900 req-6fe3d605-145d-4ce0-a857-93f754f0e10e service nova] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-5bc18003-92f5-4c09-929e-d1fcf3384900 req-6fe3d605-145d-4ce0-a857-93f754f0e10e service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] No waiting events found dispatching network-vif-plugged-fd56409a-6505-48f2-95d2-8d0162ad28af {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:11:50 user nova-compute[73476]: WARNING nova.compute.manager [req-5bc18003-92f5-4c09-929e-d1fcf3384900 req-6fe3d605-145d-4ce0-a857-93f754f0e10e service nova] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Received unexpected event network-vif-plugged-fd56409a-6505-48f2-95d2-8d0162ad28af for instance with vm_state active and task_state deleting.
Aug 26 21:11:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:50 user nova-compute[73476]: INFO nova.compute.manager [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Took 0.92 seconds to detach 1 volumes for instance.
Aug 26 21:11:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Deleting volume: e5bb0c52-e50e-4105-8056-d750ce6bab6c {{(pid=73476) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 21:11:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:51 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:11:51 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:11:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:51 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Deleted allocations for instance a106a9ab-407a-49b1-99fd-6406b89e065c
Aug 26 21:11:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-40090dfc-9b73-4463-9932-9fc74b1c5dfb tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "a106a9ab-407a-49b1-99fd-6406b89e065c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.572s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:52 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:11:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:11:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:11:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:11:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:56 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:11:57 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:11:57 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:11:57 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.176559448242188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:11:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:11:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:11:57 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:11:57 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:11:57 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:11:57 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:11:57 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:11:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:11:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:03 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084308.490663, a106a9ab-407a-49b1-99fd-6406b89e065c => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:12:03 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] VM Stopped (Lifecycle Event)
Aug 26 21:12:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-de5e323e-0965-4b22-a7fa-0be0aad7cf88 None None] [instance: a106a9ab-407a-49b1-99fd-6406b89e065c] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:12:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:03 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:09 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:09 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:12:10 user nova-compute[73476]: INFO nova.compute.claims [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Claim successful on node user
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:12:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.policy [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d2ff94872bd43dd8f7e4319e9e63934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed24e21a3624f4e8a4311728ff1c9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:12:10 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Creating image(s)
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "/opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "/opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:10 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk 1073741824" returned: 0 in 0.203s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.389s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Successfully created port: 5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Cannot resize image /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Ensure instance console log exists: /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Successfully updated port: 5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquired lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-5ae745ac-f963-47c2-981c-b10520842816 req-5f99e4cf-0dd4-4cb6-a701-c370b207084d service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received event network-changed-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.compute.manager [req-5ae745ac-f963-47c2-981c-b10520842816 req-5f99e4cf-0dd4-4cb6-a701-c370b207084d service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Refreshing instance network info cache due to event network-changed-5e886f15-1894-41a0-a44e-ce2f8b748af7. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5ae745ac-f963-47c2-981c-b10520842816 req-5f99e4cf-0dd4-4cb6-a701-c370b207084d service nova] Acquiring lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.neutron [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updating instance_info_cache with network_info: [{"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Releasing lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Instance network_info: |[{"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5ae745ac-f963-47c2-981c-b10520842816 req-5f99e4cf-0dd4-4cb6-a701-c370b207084d service nova] Acquired lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.neutron [req-5ae745ac-f963-47c2-981c-b10520842816 req-5f99e4cf-0dd4-4cb6-a701-c370b207084d service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Refreshing network info cache for port 5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Start _get_guest_xml network_info=[{"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:12:12 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:12:12 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1352576100',display_name='tempest-AttachVolumeTestJSON-server-1352576100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1352576100',id=47,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCckA0zLA6iCaFy93SxxlC61wGLTQlP8Mf4zPfNJKBxZc/CKnA+JR+dSd0CuYbv6epHduMlpyC6pKj0nEhCf5S3MderD5homNewI63sv9EjWDAVIi1rWe1le2/dc8xdQ==',key_name='tempest-keypair-107465683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-11w330ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:12:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=4ed0ca87-528c-4712-9445-8cce12137ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:9f:9b,bridge_name='br-int',has_traffic_filtering=True,id=5e886f15-1894-41a0-a44e-ce2f8b748af7,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e886f15-18') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:12:12 user nova-compute[73476]:   <uuid>4ed0ca87-528c-4712-9445-8cce12137ed4</uuid>
Aug 26 21:12:12 user nova-compute[73476]:   <name>instance-0000002f</name>
Aug 26 21:12:12 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:12:12 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:12:12 user nova-compute[73476]:   <metadata>
Aug 26 21:12:12 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:12:12 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:12:12 user nova-compute[73476]:       <nova:name>tempest-AttachVolumeTestJSON-server-1352576100</nova:name>
Aug 26 21:12:12 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:12:12</nova:creationTime>
Aug 26 21:12:12 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:12:12 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:12:12 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:12:12 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:12:12 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:12:12 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:12:12 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:12:12 user nova-compute[73476]:       <nova:owner>
Aug 26 21:12:12 user nova-compute[73476]:         <nova:user uuid="4d2ff94872bd43dd8f7e4319e9e63934">tempest-AttachVolumeTestJSON-359578438-project-member</nova:user>
Aug 26 21:12:12 user nova-compute[73476]:         <nova:project uuid="3ed24e21a3624f4e8a4311728ff1c9f5">tempest-AttachVolumeTestJSON-359578438</nova:project>
Aug 26 21:12:12 user nova-compute[73476]:       </nova:owner>
Aug 26 21:12:12 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:12:12 user nova-compute[73476]:       <nova:ports>
Aug 26 21:12:12 user nova-compute[73476]:         <nova:port uuid="5e886f15-1894-41a0-a44e-ce2f8b748af7">
Aug 26 21:12:12 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 21:12:12 user nova-compute[73476]:         </nova:port>
Aug 26 21:12:12 user nova-compute[73476]:       </nova:ports>
Aug 26 21:12:12 user nova-compute[73476]:     </nova:instance>
Aug 26 21:12:12 user nova-compute[73476]:   </metadata>
Aug 26 21:12:12 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:12:12 user nova-compute[73476]:     <system>
Aug 26 21:12:12 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:12:12 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:12:12 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:12:12 user nova-compute[73476]:       <entry name="serial">4ed0ca87-528c-4712-9445-8cce12137ed4</entry>
Aug 26 21:12:12 user nova-compute[73476]:       <entry name="uuid">4ed0ca87-528c-4712-9445-8cce12137ed4</entry>
Aug 26 21:12:12 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:12:12 user nova-compute[73476]:     </system>
Aug 26 21:12:12 user nova-compute[73476]:   </sysinfo>
Aug 26 21:12:12 user nova-compute[73476]:   <os>
Aug 26 21:12:12 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:12:12 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:12:12 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:12:12 user nova-compute[73476]:   </os>
Aug 26 21:12:12 user nova-compute[73476]:   <features>
Aug 26 21:12:12 user nova-compute[73476]:     <acpi/>
Aug 26 21:12:12 user nova-compute[73476]:     <apic/>
Aug 26 21:12:12 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:12:12 user nova-compute[73476]:   </features>
Aug 26 21:12:12 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:12:12 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:12:12 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:12:12 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:12:12 user nova-compute[73476]:   </clock>
Aug 26 21:12:12 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:12:12 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:12:12 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:12:12 user nova-compute[73476]:   </cpu>
Aug 26 21:12:12 user nova-compute[73476]:   <devices>
Aug 26 21:12:12 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:12:12 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:12:12 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk"/>
Aug 26 21:12:12 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:12:12 user nova-compute[73476]:     </disk>
Aug 26 21:12:12 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:12:12 user nova-compute[73476]:       <mac address="fa:16:3e:1e:9f:9b"/>
Aug 26 21:12:12 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:12:12 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:12:12 user nova-compute[73476]:       <target dev="tap5e886f15-18"/>
Aug 26 21:12:12 user nova-compute[73476]:     </interface>
Aug 26 21:12:12 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:12:12 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/console.log" append="off"/>
Aug 26 21:12:12 user nova-compute[73476]:     </serial>
Aug 26 21:12:12 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:12:12 user nova-compute[73476]:     <video>
Aug 26 21:12:12 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:12:12 user nova-compute[73476]:     </video>
Aug 26 21:12:12 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:12:12 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:12:12 user nova-compute[73476]:     </rng>
Aug 26 21:12:12 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:12:12 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:12:12 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:12:12 user nova-compute[73476]:     </memballoon>
Aug 26 21:12:12 user nova-compute[73476]:   </devices>
Aug 26 21:12:12 user nova-compute[73476]: </domain>
Aug 26 21:12:12 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1352576100',display_name='tempest-AttachVolumeTestJSON-server-1352576100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1352576100',id=47,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCckA0zLA6iCaFy93SxxlC61wGLTQlP8Mf4zPfNJKBxZc/CKnA+JR+dSd0CuYbv6epHduMlpyC6pKj0nEhCf5S3MderD5homNewI63sv9EjWDAVIi1rWe1le2/dc8xdQ==',key_name='tempest-keypair-107465683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-11w330ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:12:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=4ed0ca87-528c-4712-9445-8cce12137ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:9f:9b,bridge_name='br-int',has_traffic_filtering=True,id=5e886f15-1894-41a0-a44e-ce2f8b748af7,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e886f15-18') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG os_vif [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:9f:9b,bridge_name='br-int',has_traffic_filtering=True,id=5e886f15-1894-41a0-a44e-ce2f8b748af7,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e886f15-18') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e886f15-18, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e886f15-18, col_values=(('external_ids', {'iface-id': '5e886f15-1894-41a0-a44e-ce2f8b748af7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:9f:9b', 'vm-uuid': '4ed0ca87-528c-4712-9445-8cce12137ed4'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:12 user nova-compute[73476]: INFO os_vif [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:9f:9b,bridge_name='br-int',has_traffic_filtering=True,id=5e886f15-1894-41a0-a44e-ce2f8b748af7,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e886f15-18')
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No VIF found with MAC fa:16:3e:1e:9f:9b, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.neutron [req-5ae745ac-f963-47c2-981c-b10520842816 req-5f99e4cf-0dd4-4cb6-a701-c370b207084d service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updated VIF entry in instance network info cache for port 5e886f15-1894-41a0-a44e-ce2f8b748af7. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG nova.network.neutron [req-5ae745ac-f963-47c2-981c-b10520842816 req-5f99e4cf-0dd4-4cb6-a701-c370b207084d service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updating instance_info_cache with network_info: [{"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:12:12 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5ae745ac-f963-47c2-981c-b10520842816 req-5f99e4cf-0dd4-4cb6-a701-c370b207084d service nova] Releasing lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-654f7fd5-92bf-4292-9849-41535d94e76d req-19ac3b69-d1ad-4369-bd4f-433cad3bdee6 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received event network-vif-plugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-654f7fd5-92bf-4292-9849-41535d94e76d req-19ac3b69-d1ad-4369-bd4f-433cad3bdee6 service nova] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-654f7fd5-92bf-4292-9849-41535d94e76d req-19ac3b69-d1ad-4369-bd4f-433cad3bdee6 service nova] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-654f7fd5-92bf-4292-9849-41535d94e76d req-19ac3b69-d1ad-4369-bd4f-433cad3bdee6 service nova] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG nova.compute.manager [req-654f7fd5-92bf-4292-9849-41535d94e76d req-19ac3b69-d1ad-4369-bd4f-433cad3bdee6 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] No waiting events found dispatching network-vif-plugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:12:14 user nova-compute[73476]: WARNING nova.compute.manager [req-654f7fd5-92bf-4292-9849-41535d94e76d req-19ac3b69-d1ad-4369-bd4f-433cad3bdee6 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received unexpected event network-vif-plugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 for instance with vm_state building and task_state spawning.
Aug 26 21:12:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084336.3119848, 4ed0ca87-528c-4712-9445-8cce12137ed4 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:12:16 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] VM Resumed (Lifecycle Event)
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1f6a94b-597c-4dba-a036-f7b36fdc6290 req-02867569-d5d4-49ac-9b89-e43f82b7d238 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received event network-vif-plugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1f6a94b-597c-4dba-a036-f7b36fdc6290 req-02867569-d5d4-49ac-9b89-e43f82b7d238 service nova] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1f6a94b-597c-4dba-a036-f7b36fdc6290 req-02867569-d5d4-49ac-9b89-e43f82b7d238 service nova] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f1f6a94b-597c-4dba-a036-f7b36fdc6290 req-02867569-d5d4-49ac-9b89-e43f82b7d238 service nova] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.compute.manager [req-f1f6a94b-597c-4dba-a036-f7b36fdc6290 req-02867569-d5d4-49ac-9b89-e43f82b7d238 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] No waiting events found dispatching network-vif-plugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:12:16 user nova-compute[73476]: WARNING nova.compute.manager [req-f1f6a94b-597c-4dba-a036-f7b36fdc6290 req-02867569-d5d4-49ac-9b89-e43f82b7d238 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received unexpected event network-vif-plugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 for instance with vm_state building and task_state spawning.
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:12:16 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Instance spawned successfully.
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:12:16 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084336.3132193, 4ed0ca87-528c-4712-9445-8cce12137ed4 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:12:16 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] VM Started (Lifecycle Event)
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:12:16 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:12:16 user nova-compute[73476]: INFO nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 26 21:12:16 user nova-compute[73476]: DEBUG nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:12:16 user nova-compute[73476]: INFO nova.compute.manager [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Took 6.57 seconds to build instance.
Aug 26 21:12:16 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2f686d96-0e62-4488-ac8e-d64392b73756 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.668s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:12:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:12:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:43 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73476) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 21:12:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:46 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:12:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:47 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:52 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "be98156a-6391-4191-b33b-699b60241f2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:55 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "be98156a-6391-4191-b33b-699b60241f2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:55 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:12:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:12:56 user nova-compute[73476]: INFO nova.compute.claims [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Claim successful on node user
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Refreshing inventories for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Updating ProviderTree inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Refreshing aggregate associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, aggregates: None {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Refreshing trait associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:12:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] Skipping network cache update for instance because it is Building. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 21:12:56 user nova-compute[73476]: INFO nova.virt.block_device [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Booting with volume a1edaf07-8b67-473a-b42c-800fffb2379d at /dev/vda
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.policy [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bb1fc1180d34eb0ae98c52187aae87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1962b32d78d4f6da29bb0fdaa001363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG os_brick.utils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb98f46a-90e7-4dbc-a4ec-ad4f3af33183]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0926ec2a-dbcb-4e25-a1fa-98e974e503e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef0e3a4-f1c0-4949-8a51-ef749ec2efc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d183fab2-24d1-43e2-bb63-39f12a0f27ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:12:56 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:12:56 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcedaa9-c324-43b8-87e3-de8362f614d7]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG os_brick.utils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:12:56 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Updating existing volume attachment record: 1233bdac-4363-4fed-a043-0be517bac9e4 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updating instance_info_cache with network_info: [{"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:12:57 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Successfully created port: 0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:12:58 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:12:58 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:12:58 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=25.13581085205078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 4ed0ca87-528c-4712-9445-8cce12137ed4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance be98156a-6391-4191-b33b-699b60241f2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:12:58 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Successfully updated port: 0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "refresh_cache-be98156a-6391-4191-b33b-699b60241f2f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquired lock "refresh_cache-be98156a-6391-4191-b33b-699b60241f2f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-6a959a44-8fde-4872-89d5-7a56872d8b63 req-0f3fdc37-b430-4857-9fbd-c75d9230da86 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received event network-changed-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.manager [req-6a959a44-8fde-4872-89d5-7a56872d8b63 req-0f3fdc37-b430-4857-9fbd-c75d9230da86 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Refreshing instance network info cache due to event network-changed-0a217bac-0b90-4df1-96d6-ea44bea62d9e. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6a959a44-8fde-4872-89d5-7a56872d8b63 req-0f3fdc37-b430-4857-9fbd-c75d9230da86 service nova] Acquiring lock "refresh_cache-be98156a-6391-4191-b33b-699b60241f2f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "95313732-78dd-4689-b752-ae095d803408" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:12:59 user nova-compute[73476]: INFO nova.compute.claims [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Claim successful on node user
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Updating instance_info_cache with network_info: [{"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Releasing lock "refresh_cache-be98156a-6391-4191-b33b-699b60241f2f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Instance network_info: |[{"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6a959a44-8fde-4872-89d5-7a56872d8b63 req-0f3fdc37-b430-4857-9fbd-c75d9230da86 service nova] Acquired lock "refresh_cache-be98156a-6391-4191-b33b-699b60241f2f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.network.neutron [req-6a959a44-8fde-4872-89d5-7a56872d8b63 req-0f3fdc37-b430-4857-9fbd-c75d9230da86 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Refreshing network info cache for port 0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:12:59 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:12:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.policy [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fbddcd2549d496fbe3c3ea2d93779bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5839ce6ffbec4fbeacaca0e424362ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:13:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Creating image(s)
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "/opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "/opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "/opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.network.neutron [req-6a959a44-8fde-4872-89d5-7a56872d8b63 req-0f3fdc37-b430-4857-9fbd-c75d9230da86 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Updated VIF entry in instance network info cache for port 0a217bac-0b90-4df1-96d6-ea44bea62d9e. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.network.neutron [req-6a959a44-8fde-4872-89d5-7a56872d8b63 req-0f3fdc37-b430-4857-9fbd-c75d9230da86 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Updating instance_info_cache with network_info: [{"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6a959a44-8fde-4872-89d5-7a56872d8b63 req-0f3fdc37-b430-4857-9fbd-c75d9230da86 service nova] Releasing lock "refresh_cache-be98156a-6391-4191-b33b-699b60241f2f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.177s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk 1073741824" returned: 0 in 0.056s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Successfully created port: 3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Cannot resize image /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Ensure instance console log exists: /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:13:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Successfully updated port: 3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:13:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:13:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquired lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:13:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:13:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-69075379-317d-403c-92a7-77b1a8001a7a req-eecb2a5e-57ff-4b04-a575-e4d5a562ab8c service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received event network-changed-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:13:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-69075379-317d-403c-92a7-77b1a8001a7a req-eecb2a5e-57ff-4b04-a575-e4d5a562ab8c service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Refreshing instance network info cache due to event network-changed-3b56baf2-efe1-4b87-93f1-a6619ac34787. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:13:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-69075379-317d-403c-92a7-77b1a8001a7a req-eecb2a5e-57ff-4b04-a575-e4d5a562ab8c service nova] Acquiring lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:13:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Updating instance_info_cache with network_info: [{"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Releasing lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Instance network_info: |[{"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-69075379-317d-403c-92a7-77b1a8001a7a req-eecb2a5e-57ff-4b04-a575-e4d5a562ab8c service nova] Acquired lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.network.neutron [req-69075379-317d-403c-92a7-77b1a8001a7a req-eecb2a5e-57ff-4b04-a575-e4d5a562ab8c service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Refreshing network info cache for port 3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Start _get_guest_xml network_info=[{"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:13:02 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:13:02 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1175667773',display_name='tempest-TestServerVolumeAttachmentScenario-server-1175667773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1175667773',id=49,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO08J3P2O3FGqkNBMPpGLALqH+SsKGiqn1Zi+PgVwE493qzXxIuKJc7scT+kd8GWTRTnMeSGsWF98jW042FaS2FO7ZH/NOAier2AdpYxm3P5rTzpssQ7SM8jxPoqzD4vbg==',key_name='tempest-keypair-798354452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5839ce6ffbec4fbeacaca0e424362ce4',ramdisk_id='',reservation_id='r-y4sja7p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2040081678',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2040081678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbddcd2549d496fbe3c3ea2d93779bc',uuid=95313732-78dd-4689-b752-ae095d803408,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Converting VIF {"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:97:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b56baf2-efe1-4b87-93f1-a6619ac34787,network=Network(af4d9e56-9830-4e8b-9c83-4aa050808aa9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b56baf2-ef') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.objects.instance [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lazy-loading 'pci_devices' on Instance uuid 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:13:02 user nova-compute[73476]:   <uuid>95313732-78dd-4689-b752-ae095d803408</uuid>
Aug 26 21:13:02 user nova-compute[73476]:   <name>instance-00000031</name>
Aug 26 21:13:02 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:13:02 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:13:02 user nova-compute[73476]:   <metadata>
Aug 26 21:13:02 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:13:02 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:13:02 user nova-compute[73476]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1175667773</nova:name>
Aug 26 21:13:02 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:13:02</nova:creationTime>
Aug 26 21:13:02 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:13:02 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:13:02 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:13:02 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:13:02 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:13:02 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:13:02 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:13:02 user nova-compute[73476]:       <nova:owner>
Aug 26 21:13:02 user nova-compute[73476]:         <nova:user uuid="3fbddcd2549d496fbe3c3ea2d93779bc">tempest-TestServerVolumeAttachmentScenario-2040081678-project-member</nova:user>
Aug 26 21:13:02 user nova-compute[73476]:         <nova:project uuid="5839ce6ffbec4fbeacaca0e424362ce4">tempest-TestServerVolumeAttachmentScenario-2040081678</nova:project>
Aug 26 21:13:02 user nova-compute[73476]:       </nova:owner>
Aug 26 21:13:02 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:13:02 user nova-compute[73476]:       <nova:ports>
Aug 26 21:13:02 user nova-compute[73476]:         <nova:port uuid="3b56baf2-efe1-4b87-93f1-a6619ac34787">
Aug 26 21:13:02 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 21:13:02 user nova-compute[73476]:         </nova:port>
Aug 26 21:13:02 user nova-compute[73476]:       </nova:ports>
Aug 26 21:13:02 user nova-compute[73476]:     </nova:instance>
Aug 26 21:13:02 user nova-compute[73476]:   </metadata>
Aug 26 21:13:02 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:13:02 user nova-compute[73476]:     <system>
Aug 26 21:13:02 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:13:02 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:13:02 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:13:02 user nova-compute[73476]:       <entry name="serial">95313732-78dd-4689-b752-ae095d803408</entry>
Aug 26 21:13:02 user nova-compute[73476]:       <entry name="uuid">95313732-78dd-4689-b752-ae095d803408</entry>
Aug 26 21:13:02 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:13:02 user nova-compute[73476]:     </system>
Aug 26 21:13:02 user nova-compute[73476]:   </sysinfo>
Aug 26 21:13:02 user nova-compute[73476]:   <os>
Aug 26 21:13:02 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:13:02 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:13:02 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:13:02 user nova-compute[73476]:   </os>
Aug 26 21:13:02 user nova-compute[73476]:   <features>
Aug 26 21:13:02 user nova-compute[73476]:     <acpi/>
Aug 26 21:13:02 user nova-compute[73476]:     <apic/>
Aug 26 21:13:02 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:13:02 user nova-compute[73476]:   </features>
Aug 26 21:13:02 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:13:02 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:13:02 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:13:02 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:13:02 user nova-compute[73476]:   </clock>
Aug 26 21:13:02 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:13:02 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:13:02 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:13:02 user nova-compute[73476]:   </cpu>
Aug 26 21:13:02 user nova-compute[73476]:   <devices>
Aug 26 21:13:02 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:13:02 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:13:02 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk"/>
Aug 26 21:13:02 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:13:02 user nova-compute[73476]:     </disk>
Aug 26 21:13:02 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:13:02 user nova-compute[73476]:       <mac address="fa:16:3e:7f:97:3a"/>
Aug 26 21:13:02 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:13:02 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:13:02 user nova-compute[73476]:       <target dev="tap3b56baf2-ef"/>
Aug 26 21:13:02 user nova-compute[73476]:     </interface>
Aug 26 21:13:02 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:13:02 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/console.log" append="off"/>
Aug 26 21:13:02 user nova-compute[73476]:     </serial>
Aug 26 21:13:02 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:13:02 user nova-compute[73476]:     <video>
Aug 26 21:13:02 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:13:02 user nova-compute[73476]:     </video>
Aug 26 21:13:02 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:13:02 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:13:02 user nova-compute[73476]:     </rng>
Aug 26 21:13:02 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:13:02 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:13:02 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:13:02 user nova-compute[73476]:     </memballoon>
Aug 26 21:13:02 user nova-compute[73476]:   </devices>
Aug 26 21:13:02 user nova-compute[73476]: </domain>
Aug 26 21:13:02 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1175667773',display_name='tempest-TestServerVolumeAttachmentScenario-server-1175667773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1175667773',id=49,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO08J3P2O3FGqkNBMPpGLALqH+SsKGiqn1Zi+PgVwE493qzXxIuKJc7scT+kd8GWTRTnMeSGsWF98jW042FaS2FO7ZH/NOAier2AdpYxm3P5rTzpssQ7SM8jxPoqzD4vbg==',key_name='tempest-keypair-798354452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5839ce6ffbec4fbeacaca0e424362ce4',ramdisk_id='',reservation_id='r-y4sja7p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2040081678',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2040081678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbddcd2549d496fbe3c3ea2d93779bc',uuid=95313732-78dd-4689-b752-ae095d803408,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Converting VIF {"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:97:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b56baf2-efe1-4b87-93f1-a6619ac34787,network=Network(af4d9e56-9830-4e8b-9c83-4aa050808aa9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b56baf2-ef') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG os_vif [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:97:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b56baf2-efe1-4b87-93f1-a6619ac34787,network=Network(af4d9e56-9830-4e8b-9c83-4aa050808aa9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b56baf2-ef') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b56baf2-ef, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b56baf2-ef, col_values=(('external_ids', {'iface-id': '3b56baf2-efe1-4b87-93f1-a6619ac34787', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:97:3a', 'vm-uuid': '95313732-78dd-4689-b752-ae095d803408'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:02 user nova-compute[73476]: INFO os_vif [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:97:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b56baf2-efe1-4b87-93f1-a6619ac34787,network=Network(af4d9e56-9830-4e8b-9c83-4aa050808aa9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b56baf2-ef')
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:13:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] No VIF found with MAC fa:16:3e:7f:97:3a, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:13:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-69075379-317d-403c-92a7-77b1a8001a7a req-eecb2a5e-57ff-4b04-a575-e4d5a562ab8c service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Updated VIF entry in instance network info cache for port 3b56baf2-efe1-4b87-93f1-a6619ac34787. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:13:03 user nova-compute[73476]: DEBUG nova.network.neutron [req-69075379-317d-403c-92a7-77b1a8001a7a req-eecb2a5e-57ff-4b04-a575-e4d5a562ab8c service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Updating instance_info_cache with network_info: [{"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:13:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-69075379-317d-403c-92a7-77b1a8001a7a req-eecb2a5e-57ff-4b04-a575-e4d5a562ab8c service nova] Releasing lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-7e37d74c-a883-4046-aaf2-fea31c3c781a req-0825d397-efeb-499c-80c6-ce6b746a9ad1 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received event network-vif-plugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7e37d74c-a883-4046-aaf2-fea31c3c781a req-0825d397-efeb-499c-80c6-ce6b746a9ad1 service nova] Acquiring lock "95313732-78dd-4689-b752-ae095d803408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7e37d74c-a883-4046-aaf2-fea31c3c781a req-0825d397-efeb-499c-80c6-ce6b746a9ad1 service nova] Lock "95313732-78dd-4689-b752-ae095d803408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-7e37d74c-a883-4046-aaf2-fea31c3c781a req-0825d397-efeb-499c-80c6-ce6b746a9ad1 service nova] Lock "95313732-78dd-4689-b752-ae095d803408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-7e37d74c-a883-4046-aaf2-fea31c3c781a req-0825d397-efeb-499c-80c6-ce6b746a9ad1 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] No waiting events found dispatching network-vif-plugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:13:04 user nova-compute[73476]: WARNING nova.compute.manager [req-7e37d74c-a883-4046-aaf2-fea31c3c781a req-0825d397-efeb-499c-80c6-ce6b746a9ad1 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received unexpected event network-vif-plugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 for instance with vm_state building and task_state spawning.
Aug 26 21:13:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:04 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:05 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:05 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084386.2691915, 95313732-78dd-4689-b752-ae095d803408 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:13:06 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] VM Resumed (Lifecycle Event)
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:13:06 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 95313732-78dd-4689-b752-ae095d803408] Instance spawned successfully.
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:06 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084386.2707767, 95313732-78dd-4689-b752-ae095d803408 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:13:06 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] VM Started (Lifecycle Event)
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:13:06 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:13:06 user nova-compute[73476]: INFO nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Took 6.32 seconds to spawn the instance on the hypervisor.
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-ae856b71-dd0e-4842-9156-2a95cff134a4 req-40406cd2-54b3-458d-8cbe-607044725191 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received event network-vif-plugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ae856b71-dd0e-4842-9156-2a95cff134a4 req-40406cd2-54b3-458d-8cbe-607044725191 service nova] Acquiring lock "95313732-78dd-4689-b752-ae095d803408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ae856b71-dd0e-4842-9156-2a95cff134a4 req-40406cd2-54b3-458d-8cbe-607044725191 service nova] Lock "95313732-78dd-4689-b752-ae095d803408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ae856b71-dd0e-4842-9156-2a95cff134a4 req-40406cd2-54b3-458d-8cbe-607044725191 service nova] Lock "95313732-78dd-4689-b752-ae095d803408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:06 user nova-compute[73476]: DEBUG nova.compute.manager [req-ae856b71-dd0e-4842-9156-2a95cff134a4 req-40406cd2-54b3-458d-8cbe-607044725191 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] No waiting events found dispatching network-vif-plugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:13:06 user nova-compute[73476]: WARNING nova.compute.manager [req-ae856b71-dd0e-4842-9156-2a95cff134a4 req-40406cd2-54b3-458d-8cbe-607044725191 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received unexpected event network-vif-plugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 for instance with vm_state building and task_state spawning.
Aug 26 21:13:06 user nova-compute[73476]: INFO nova.compute.manager [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Took 7.19 seconds to build instance.
Aug 26 21:13:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-1334ccc5-36ac-4570-ac37-78dacd27f0b6 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.294s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:13 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:13 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 21:13:13 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] There are 0 instances to clean {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:13:15 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Creating image(s)
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Ensure instance console log exists: /opt/stack/data/nova/instances/be98156a-6391-4191-b33b-699b60241f2f/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Start _get_guest_xml network_info=[{"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '1233bdac-4363-4fed-a043-0be517bac9e4', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcZJKLou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be98156a-6391-4191-b33b-699b60241f2f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1edaf07-8b67-473a-b42c-800fffb2379d', 'serial': 'a1edaf07-8b67-473a-b42c-800fffb2379d'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:13:15 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:13:15 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcZJKLou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:13:15 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:13:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:13:15 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:13:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:13:15 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:13:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c590d329-faf7-4c34-a2f6-cdfd108b1dc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:13:15 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:13:15 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[421fedf3-7a19-42e9-bde3-db4b6948b2a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d] added
Aug 26 21:13:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[25832022-6d1a-4626-93c0-01c88d266b9e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0383dd-c90b-4178-bf52-b39c7bb5b95f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcZJKLou {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcZJKLou" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d719e5-723f-4370-a2a3-693042c091e0]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tcZJKLou'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bd494a-e9d3-4eac-99e4-4c4ec412eb14]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce0b1eb-4c59-4c4e-89fe-a1e5562899e7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 21:13:16 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 21:13:16 user nova-compute[73476]:  {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:13:16 user nova-compute[73476]: WARNING os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 21:13:16 user nova-compute[73476]: 
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced3fd6e-e3ab-4b37-b773-4da44dbcde5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260]
Aug 26 21:13:16 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260] successful.
Aug 26 21:13:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[546abf5b-e4c4-4e90-961e-107b3ca14cc6]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93366e8-c62b-489b-8bbf-b9dca02fef1f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:13:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:13:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26ffbe7-61d6-47e0-9151-c189c1e11627]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:13:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcZJKLou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26630636135333931', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630636135333931', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-627608153',display_name='tempest-TestVolumeBootPattern-server-627608153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-627608153',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp0nGdKWqt25Vovv//zECtWPkdETKJV26I8dVi13Vaw97KRWRRvyx63r4FOvfGKO/4n655MVUFeORvL2Dj2aVlVmOVr7QUBY9FdJPdc/33XGtLV0TAuage04axfNiAeSg==',key_name='tempest-TestVolumeBootPattern-1669868756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-0p25pgn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:12:57Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=be98156a-6391-4191-b33b-699b60241f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:12:63,bridge_name='br-int',has_traffic_filtering=True,id=0a217bac-0b90-4df1-96d6-ea44bea62d9e,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a217bac-0b') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.objects.instance [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'pci_devices' on Instance uuid be98156a-6391-4191-b33b-699b60241f2f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:13:17 user nova-compute[73476]:   <uuid>be98156a-6391-4191-b33b-699b60241f2f</uuid>
Aug 26 21:13:17 user nova-compute[73476]:   <name>instance-00000030</name>
Aug 26 21:13:17 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:13:17 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:13:17 user nova-compute[73476]:   <metadata>
Aug 26 21:13:17 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:13:17 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:13:17 user nova-compute[73476]:       <nova:name>tempest-TestVolumeBootPattern-server-627608153</nova:name>
Aug 26 21:13:17 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:13:15</nova:creationTime>
Aug 26 21:13:17 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:13:17 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:13:17 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:13:17 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:13:17 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:13:17 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:13:17 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:13:17 user nova-compute[73476]:       <nova:owner>
Aug 26 21:13:17 user nova-compute[73476]:         <nova:user uuid="5bb1fc1180d34eb0ae98c52187aae87e">tempest-TestVolumeBootPattern-443030295-project-member</nova:user>
Aug 26 21:13:17 user nova-compute[73476]:         <nova:project uuid="a1962b32d78d4f6da29bb0fdaa001363">tempest-TestVolumeBootPattern-443030295</nova:project>
Aug 26 21:13:17 user nova-compute[73476]:       </nova:owner>
Aug 26 21:13:17 user nova-compute[73476]:       <nova:ports>
Aug 26 21:13:17 user nova-compute[73476]:         <nova:port uuid="0a217bac-0b90-4df1-96d6-ea44bea62d9e">
Aug 26 21:13:17 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 21:13:17 user nova-compute[73476]:         </nova:port>
Aug 26 21:13:17 user nova-compute[73476]:       </nova:ports>
Aug 26 21:13:17 user nova-compute[73476]:     </nova:instance>
Aug 26 21:13:17 user nova-compute[73476]:   </metadata>
Aug 26 21:13:17 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:13:17 user nova-compute[73476]:     <system>
Aug 26 21:13:17 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:13:17 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:13:17 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:13:17 user nova-compute[73476]:       <entry name="serial">be98156a-6391-4191-b33b-699b60241f2f</entry>
Aug 26 21:13:17 user nova-compute[73476]:       <entry name="uuid">be98156a-6391-4191-b33b-699b60241f2f</entry>
Aug 26 21:13:17 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:13:17 user nova-compute[73476]:     </system>
Aug 26 21:13:17 user nova-compute[73476]:   </sysinfo>
Aug 26 21:13:17 user nova-compute[73476]:   <os>
Aug 26 21:13:17 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:13:17 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:13:17 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:13:17 user nova-compute[73476]:   </os>
Aug 26 21:13:17 user nova-compute[73476]:   <features>
Aug 26 21:13:17 user nova-compute[73476]:     <acpi/>
Aug 26 21:13:17 user nova-compute[73476]:     <apic/>
Aug 26 21:13:17 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:13:17 user nova-compute[73476]:   </features>
Aug 26 21:13:17 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:13:17 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:13:17 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:13:17 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:13:17 user nova-compute[73476]:   </clock>
Aug 26 21:13:17 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:13:17 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:13:17 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:13:17 user nova-compute[73476]:   </cpu>
Aug 26 21:13:17 user nova-compute[73476]:   <devices>
Aug 26 21:13:17 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 21:13:17 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:13:17 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 21:13:17 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:13:17 user nova-compute[73476]:       <serial>a1edaf07-8b67-473a-b42c-800fffb2379d</serial>
Aug 26 21:13:17 user nova-compute[73476]:     </disk>
Aug 26 21:13:17 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:13:17 user nova-compute[73476]:       <mac address="fa:16:3e:15:12:63"/>
Aug 26 21:13:17 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:13:17 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:13:17 user nova-compute[73476]:       <target dev="tap0a217bac-0b"/>
Aug 26 21:13:17 user nova-compute[73476]:     </interface>
Aug 26 21:13:17 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:13:17 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/be98156a-6391-4191-b33b-699b60241f2f/console.log" append="off"/>
Aug 26 21:13:17 user nova-compute[73476]:     </serial>
Aug 26 21:13:17 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:13:17 user nova-compute[73476]:     <video>
Aug 26 21:13:17 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:13:17 user nova-compute[73476]:     </video>
Aug 26 21:13:17 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:13:17 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:13:17 user nova-compute[73476]:     </rng>
Aug 26 21:13:17 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:13:17 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:13:17 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:13:17 user nova-compute[73476]:     </memballoon>
Aug 26 21:13:17 user nova-compute[73476]:   </devices>
Aug 26 21:13:17 user nova-compute[73476]: </domain>
Aug 26 21:13:17 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-627608153',display_name='tempest-TestVolumeBootPattern-server-627608153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-627608153',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp0nGdKWqt25Vovv//zECtWPkdETKJV26I8dVi13Vaw97KRWRRvyx63r4FOvfGKO/4n655MVUFeORvL2Dj2aVlVmOVr7QUBY9FdJPdc/33XGtLV0TAuage04axfNiAeSg==',key_name='tempest-TestVolumeBootPattern-1669868756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-0p25pgn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:12:57Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=be98156a-6391-4191-b33b-699b60241f2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:12:63,bridge_name='br-int',has_traffic_filtering=True,id=0a217bac-0b90-4df1-96d6-ea44bea62d9e,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a217bac-0b') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG os_vif [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:12:63,bridge_name='br-int',has_traffic_filtering=True,id=0a217bac-0b90-4df1-96d6-ea44bea62d9e,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a217bac-0b') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a217bac-0b, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a217bac-0b, col_values=(('external_ids', {'iface-id': '0a217bac-0b90-4df1-96d6-ea44bea62d9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:12:63', 'vm-uuid': 'be98156a-6391-4191-b33b-699b60241f2f'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:17 user nova-compute[73476]: INFO os_vif [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:12:63,bridge_name='br-int',has_traffic_filtering=True,id=0a217bac-0b90-4df1-96d6-ea44bea62d9e,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a217bac-0b')
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:13:17 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No VIF found with MAC fa:16:3e:15:12:63, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:13:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:18 user nova-compute[73476]: DEBUG nova.compute.manager [req-02d311df-3877-4746-b458-a4dccc9213af req-c554a50a-ea40-401d-98ef-402ac6848617 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received event network-vif-plugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:13:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-02d311df-3877-4746-b458-a4dccc9213af req-c554a50a-ea40-401d-98ef-402ac6848617 service nova] Acquiring lock "be98156a-6391-4191-b33b-699b60241f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-02d311df-3877-4746-b458-a4dccc9213af req-c554a50a-ea40-401d-98ef-402ac6848617 service nova] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:13:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-02d311df-3877-4746-b458-a4dccc9213af req-c554a50a-ea40-401d-98ef-402ac6848617 service nova] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:18 user nova-compute[73476]: DEBUG nova.compute.manager [req-02d311df-3877-4746-b458-a4dccc9213af req-c554a50a-ea40-401d-98ef-402ac6848617 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] No waiting events found dispatching network-vif-plugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:13:18 user nova-compute[73476]: WARNING nova.compute.manager [req-02d311df-3877-4746-b458-a4dccc9213af req-c554a50a-ea40-401d-98ef-402ac6848617 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received unexpected event network-vif-plugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e for instance with vm_state building and task_state spawning.
Aug 26 21:13:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084400.8969347, be98156a-6391-4191-b33b-699b60241f2f => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:13:20 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] VM Resumed (Lifecycle Event)
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:13:20 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: be98156a-6391-4191-b33b-699b60241f2f] Instance spawned successfully.
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:13:20 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084400.8985558, be98156a-6391-4191-b33b-699b60241f2f => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:13:20 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] VM Started (Lifecycle Event)
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:13:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:13:21 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:13:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-1e599df3-4e27-4927-a416-761de922616a req-1da5ceb9-3150-462b-9cbb-24f2470af6c8 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received event network-vif-plugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:13:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1e599df3-4e27-4927-a416-761de922616a req-1da5ceb9-3150-462b-9cbb-24f2470af6c8 service nova] Acquiring lock "be98156a-6391-4191-b33b-699b60241f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1e599df3-4e27-4927-a416-761de922616a req-1da5ceb9-3150-462b-9cbb-24f2470af6c8 service nova] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:13:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1e599df3-4e27-4927-a416-761de922616a req-1da5ceb9-3150-462b-9cbb-24f2470af6c8 service nova] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-1e599df3-4e27-4927-a416-761de922616a req-1da5ceb9-3150-462b-9cbb-24f2470af6c8 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] No waiting events found dispatching network-vif-plugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:13:21 user nova-compute[73476]: WARNING nova.compute.manager [req-1e599df3-4e27-4927-a416-761de922616a req-1da5ceb9-3150-462b-9cbb-24f2470af6c8 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received unexpected event network-vif-plugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e for instance with vm_state building and task_state spawning.
Aug 26 21:13:21 user nova-compute[73476]: INFO nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Took 5.15 seconds to spawn the instance on the hypervisor.
Aug 26 21:13:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:13:21 user nova-compute[73476]: INFO nova.compute.manager [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Took 25.33 seconds to build instance.
Aug 26 21:13:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-e4231f8b-2248-4e88-8008-163786a17375 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "be98156a-6391-4191-b33b-699b60241f2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.437s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:48 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:13:49 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:13:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:54 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:13:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:13:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:13:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:13:56 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:13:56 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:13:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updating instance_info_cache with network_info: [{"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:13:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:13:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:13:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:13:58 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:58 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:13:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:13:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:13:58 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:13:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:13:59 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:13:59 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:13:59 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8460MB free_disk=25.104721069335938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:13:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 4ed0ca87-528c-4712-9445-8cce12137ed4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:14:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance be98156a-6391-4191-b33b-699b60241f2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:14:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 95313732-78dd-4689-b752-ae095d803408 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:14:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:14:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:14:00 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:14:00 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:14:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:14:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-daf3adda-8674-48ab-a741-42062265cc2a req-7626c693-ba0e-4335-bbe9-bb6af7b46ea2 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received event network-changed-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:14:01 user nova-compute[73476]: DEBUG nova.compute.manager [req-daf3adda-8674-48ab-a741-42062265cc2a req-7626c693-ba0e-4335-bbe9-bb6af7b46ea2 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Refreshing instance network info cache due to event network-changed-5e886f15-1894-41a0-a44e-ce2f8b748af7. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:14:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-daf3adda-8674-48ab-a741-42062265cc2a req-7626c693-ba0e-4335-bbe9-bb6af7b46ea2 service nova] Acquiring lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:14:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-daf3adda-8674-48ab-a741-42062265cc2a req-7626c693-ba0e-4335-bbe9-bb6af7b46ea2 service nova] Acquired lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:14:01 user nova-compute[73476]: DEBUG nova.network.neutron [req-daf3adda-8674-48ab-a741-42062265cc2a req-7626c693-ba0e-4335-bbe9-bb6af7b46ea2 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Refreshing network info cache for port 5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:14:01 user nova-compute[73476]: DEBUG nova.network.neutron [req-daf3adda-8674-48ab-a741-42062265cc2a req-7626c693-ba0e-4335-bbe9-bb6af7b46ea2 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updated VIF entry in instance network info cache for port 5e886f15-1894-41a0-a44e-ce2f8b748af7. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:14:01 user nova-compute[73476]: DEBUG nova.network.neutron [req-daf3adda-8674-48ab-a741-42062265cc2a req-7626c693-ba0e-4335-bbe9-bb6af7b46ea2 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updating instance_info_cache with network_info: [{"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:14:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-daf3adda-8674-48ab-a741-42062265cc2a req-7626c693-ba0e-4335-bbe9-bb6af7b46ea2 service nova] Releasing lock "refresh_cache-4ed0ca87-528c-4712-9445-8cce12137ed4" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:14:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:14:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG nova.objects.instance [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:06 user nova-compute[73476]: INFO nova.compute.manager [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Attaching volume 6161bfe7-900e-4b08-a498-282d6ba66428 to /dev/vdb
Aug 26 21:14:06 user nova-compute[73476]: DEBUG os_brick.utils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b655d62-36f6-4b35-8492-1bd6e72e4513]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e39c7-5e62-4198-9585-b07ce5abc85e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad3cfa4-4aab-4bff-803f-d2392e39f407]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ff945b-0be4-4740-923f-a426af166bfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:14:06 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:14:06 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e700e4-0f34-41e2-8864-38dde08673d9]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG os_brick.utils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:14:06 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updating existing volume attachment record: d0eeec7e-a1fa-4cca-b987-89aebc5ad1cd {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:14:07 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:14:07 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:14:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHbftpue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:14:16 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:14:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:14:16 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:14:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:14:16 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cb5fa2-e673-46ca-8fba-2c9c89d0b728]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:14:16 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d602a03c-8b8b-4dbd-adab-794ab01be4c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428] added
Aug 26 21:14:16 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77dc0f8-27f8-4553-9515-6ef62693bdcd]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:16 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[83772b8c-2ca9-4b16-8542-b1771cd6be39]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHbftpue {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHbftpue" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfab8c12-d325-4e05-b0c8-a6d553dc3068]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GHbftpue'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a9b624-f41c-4025-9d64-c885edf7fa7a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e261fe19-f153-48ea-9023-07afc445da0c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:17 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:17 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fd24e8-f216-4d71-881d-95e755472f78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428, portal: 172.16.0.220,3260]
Aug 26 21:14:17 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428, portal: 172.16.0.220,3260] successful.
Aug 26 21:14:17 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[49de4849-5664-47c3-ad6e-0609a099bd18]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1740661-f229-4b72-9e36-312ab4919cec]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:17 user nova-compute[73476]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)
Aug 26 21:14:17 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:17 user nova-compute[73476]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)
Aug 26 21:14:17 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd152f82-078c-4075-9398-6dff18a494ad]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHbftpue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:14:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:14:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26136636437646237', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:14:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136636437646237', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:14:18 user nova-compute[73476]: DEBUG nova.objects.instance [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:14:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:14:18 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:14:18 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:14:18 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:14:18 user nova-compute[73476]:   <serial>6161bfe7-900e-4b08-a498-282d6ba66428</serial>
Aug 26 21:14:18 user nova-compute[73476]: </disk>
Aug 26 21:14:18 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:14:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:14:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:14:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No VIF found with MAC fa:16:3e:1e:9f:9b, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:14:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-3aa590d1-10c0-4cba-a36e-57c16420f523 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.273s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:23 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:14:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:24 user nova-compute[73476]: INFO nova.compute.manager [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Attaching volume 8693e131-1ed3-405d-9b4a-9b8637c04913 to /dev/vdc
Aug 26 21:14:24 user nova-compute[73476]: DEBUG os_brick.utils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[01940705-dddd-4860-9af9-26c3fc4fb644]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6518566e-1a53-4598-84ea-08d380664b63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3515f8bb-84ea-4335-ab1e-b433990bc142]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6696a829-6e99-4a0e-988e-de62eb4276ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:14:24 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:14:24 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d25878-470a-4c2a-b60e-2f5b7f8f0da5]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG os_brick.utils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:14:24 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updating existing volume attachment record: d8980b08-87ed-42bf-84f8-637b55ebd1ef {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:14:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:14:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:14:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:14:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:14:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:14:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:14:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uifeOMDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:14:35 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:14:35 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:14:35 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b7d6d3-f22c-41e6-8ec2-ed60d7e8c187]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:14:35 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c6ff3d-36cd-4d81-8e3f-be20f98e7637]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913] added
Aug 26 21:14:35 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4292fcb7-85b4-49b3-87fe-928b3105cc17]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c431f16-02fb-4fe9-8968-0a3322d0b5a0]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uifeOMDm {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uifeOMDm" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a1bbbc-2ab4-4d6a-9f0f-598ae1cf5f7f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uifeOMDm'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f4d91-93c3-4db5-8082-a6ceef46ba60]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ccc97f-aa6c-4380-b9dd-4db74d0a65e8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:35 user nova-compute[73476]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)
Aug 26 21:14:35 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:35 user nova-compute[73476]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)
Aug 26 21:14:35 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a06cd0-ff44-4325-9627-fc6241b22da3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913, portal: 172.16.0.220,3260]
Aug 26 21:14:35 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913, portal: 172.16.0.220,3260] successful.
Aug 26 21:14:35 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9388d057-4897-4c1f-80a1-1a67e2530e91]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d36e27-d5ac-4d1a-b8a5-aee59276498d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:35 user nova-compute[73476]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)
Aug 26 21:14:35 user nova-compute[73476]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 (non-flash)
Aug 26 21:14:35 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:35 user nova-compute[73476]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)
Aug 26 21:14:35 user nova-compute[73476]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 (non-flash)
Aug 26 21:14:35 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53307de-5489-4479-8765-58054bbfcc2d]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uifeOMDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:14:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23631653433623939', 'path': '/dev/sdd'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631653433623939', 'path': '/dev/sdd'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG nova.objects.instance [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:14:36 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:14:36 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 21:14:36 user nova-compute[73476]:   <target dev="vdc" bus="virtio"/>
Aug 26 21:14:36 user nova-compute[73476]:   <serial>8693e131-1ed3-405d-9b4a-9b8637c04913</serial>
Aug 26 21:14:36 user nova-compute[73476]: </disk>
Aug 26 21:14:36 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] No VIF found with MAC fa:16:3e:1e:9f:9b, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:14:36 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-6a7d851f-0c5e-4840-8303-3362f8ff33cc tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.801s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:38 user nova-compute[73476]: INFO nova.compute.manager [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Detaching volume 6161bfe7-900e-4b08-a498-282d6ba66428
Aug 26 21:14:38 user nova-compute[73476]: INFO nova.virt.block_device [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Attempting to driver detach volume 6161bfe7-900e-4b08-a498-282d6ba66428 from mountpoint /dev/vdb
Aug 26 21:14:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Attempting to detach device vdb from instance 4ed0ca87-528c-4712-9445-8cce12137ed4 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:14:38 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:14:38 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:14:38 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:14:38 user nova-compute[73476]:   <serial>6161bfe7-900e-4b08-a498-282d6ba66428</serial>
Aug 26 21:14:38 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:14:38 user nova-compute[73476]: </disk>
Aug 26 21:14:38 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:14:38 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully detached device vdb from instance 4ed0ca87-528c-4712-9445-8cce12137ed4 from the persistent domain config.
Aug 26 21:14:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ed0ca87-528c-4712-9445-8cce12137ed4 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:14:38 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:14:38 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:14:38 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:14:38 user nova-compute[73476]:   <serial>6161bfe7-900e-4b08-a498-282d6ba66428</serial>
Aug 26 21:14:38 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:14:38 user nova-compute[73476]: </disk>
Aug 26 21:14:38 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693084478.9325805, 4ed0ca87-528c-4712-9445-8cce12137ed4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:14:38 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully detached device vdb from instance 4ed0ca87-528c-4712-9445-8cce12137ed4 from the live domain config.
Aug 26 21:14:38 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHbftpue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:14:38 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:14:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d7e383-a358-4e33-b198-437ed6d7ced8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca6866c-9637-4c4c-9920-9b155338bb9c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:38 user nova-compute[73476]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)
Aug 26 21:14:38 user nova-compute[73476]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 (non-flash)
Aug 26 21:14:38 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:38 user nova-compute[73476]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 (non-flash)
Aug 26 21:14:38 user nova-compute[73476]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 (non-flash)
Aug 26 21:14:38 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d01f6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:14:38 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f477e30-9013-449a-bd63-3242895934e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1463fb-534a-4de1-9d38-c2abdb563a78]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f36942-8dac-43f9-9075-13e33c3d0ae3]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5972df-fe15-4816-8786-f912251cc496]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4710647a-4459-4648-86d0-70d11821afed]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82b9d0a-28e8-40d7-9672-93cecf4c0295]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428, portal: 172.16.0.220,3260]
Aug 26 21:14:39 user nova-compute[73476]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428, portal: 172.16.0.220,3260] successful.
Aug 26 21:14:39 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6161bfe7-900e-4b08-a498-282d6ba66428 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c170ca8a-bbad-41f5-a18f-791bbff6606e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== disconnect_volume: return (286ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:14:39 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:14:40 user nova-compute[73476]: DEBUG nova.objects.instance [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:14:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-d024d318-0f48-446f-a858-472dbe250f10 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.744s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:40 user nova-compute[73476]: INFO nova.compute.manager [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Detaching volume 8693e131-1ed3-405d-9b4a-9b8637c04913
Aug 26 21:14:40 user nova-compute[73476]: INFO nova.virt.block_device [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Attempting to driver detach volume 8693e131-1ed3-405d-9b4a-9b8637c04913 from mountpoint /dev/vdc
Aug 26 21:14:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Attempting to detach device vdc from instance 4ed0ca87-528c-4712-9445-8cce12137ed4 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:14:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:14:40 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:14:40 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 21:14:40 user nova-compute[73476]:   <target dev="vdc" bus="virtio"/>
Aug 26 21:14:40 user nova-compute[73476]:   <serial>8693e131-1ed3-405d-9b4a-9b8637c04913</serial>
Aug 26 21:14:40 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 21:14:40 user nova-compute[73476]: </disk>
Aug 26 21:14:40 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:14:40 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully detached device vdc from instance 4ed0ca87-528c-4712-9445-8cce12137ed4 from the persistent domain config.
Aug 26 21:14:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4ed0ca87-528c-4712-9445-8cce12137ed4 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:14:40 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:14:40 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:14:40 user nova-compute[73476]:   <source dev="/dev/sdd"/>
Aug 26 21:14:40 user nova-compute[73476]:   <target dev="vdc" bus="virtio"/>
Aug 26 21:14:40 user nova-compute[73476]:   <serial>8693e131-1ed3-405d-9b4a-9b8637c04913</serial>
Aug 26 21:14:40 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 21:14:40 user nova-compute[73476]: </disk>
Aug 26 21:14:40 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693084481.3365839, 4ed0ca87-528c-4712-9445-8cce12137ed4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:14:41 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully detached device vdc from instance 4ed0ca87-528c-4712-9445-8cce12137ed4 from the live domain config.
Aug 26 21:14:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uifeOMDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:14:41 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf8b833-7435-4827-9b30-abf8972ba3cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ef3dda-0eee-4ee6-9e0e-8ed48eb756fe]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:41 user nova-compute[73476]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 (non-flash)
Aug 26 21:14:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:41 user nova-compute[73476]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 (non-flash)
Aug 26 21:14:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25d4a56d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913'): ({'sdd'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Removing single pathed devices sdd {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ae32a5-8c70-431d-abab-8bc40ca9fe53]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[910b8317-9c9f-494e-b797-766ae0cf271f]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Flushing IO for device /dev/sdd {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb8deeb-4e58-4207-af82-ab0a0b50d116]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[213257c9-b35f-4552-883e-5d3dcfdbe638]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] SCSI volumes sdd have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bf37bb-8a4e-4903-9e15-67433f8b3278]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[83589825-e169-4314-952f-bfb280bce5ab]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913, portal: 172.16.0.220,3260]
Aug 26 21:14:41 user nova-compute[73476]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913, portal: 172.16.0.220,3260] successful.
Aug 26 21:14:41 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693e131-1ed3-405d-9b4a-9b8637c04913 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5042926d-c52e-45d3-b84d-fc2f6da337ae]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] <== disconnect_volume: return (263ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:14:41 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:14:42 user nova-compute[73476]: DEBUG nova.objects.instance [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'flavor' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:14:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-2a168db9-51aa-44ee-9691-ab5839e736a1 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:43 user nova-compute[73476]: INFO nova.compute.manager [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Terminating instance
Aug 26 21:14:43 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-4725b168-b09d-4b97-8cdc-fb0984cdfa61 req-52a78d4f-f141-4656-8363-52ea9687f887 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received event network-vif-unplugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4725b168-b09d-4b97-8cdc-fb0984cdfa61 req-52a78d4f-f141-4656-8363-52ea9687f887 service nova] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4725b168-b09d-4b97-8cdc-fb0984cdfa61 req-52a78d4f-f141-4656-8363-52ea9687f887 service nova] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-4725b168-b09d-4b97-8cdc-fb0984cdfa61 req-52a78d4f-f141-4656-8363-52ea9687f887 service nova] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-4725b168-b09d-4b97-8cdc-fb0984cdfa61 req-52a78d4f-f141-4656-8363-52ea9687f887 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] No waiting events found dispatching network-vif-unplugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:14:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-4725b168-b09d-4b97-8cdc-fb0984cdfa61 req-52a78d4f-f141-4656-8363-52ea9687f887 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received event network-vif-unplugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:44 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Instance destroyed successfully.
Aug 26 21:14:44 user nova-compute[73476]: DEBUG nova.objects.instance [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lazy-loading 'resources' on Instance uuid 4ed0ca87-528c-4712-9445-8cce12137ed4 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1352576100',display_name='tempest-AttachVolumeTestJSON-server-1352576100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1352576100',id=47,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCckA0zLA6iCaFy93SxxlC61wGLTQlP8Mf4zPfNJKBxZc/CKnA+JR+dSd0CuYbv6epHduMlpyC6pKj0nEhCf5S3MderD5homNewI63sv9EjWDAVIi1rWe1le2/dc8xdQ==',key_name='tempest-keypair-107465683',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:12:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ed24e21a3624f4e8a4311728ff1c9f5',ramdisk_id='',reservation_id='r-11w330ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-359578438',owner_user_name='tempest-AttachVolumeTestJSON-359578438-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d2ff94872bd43dd8f7e4319e9e63934',uuid=4ed0ca87-528c-4712-9445-8cce12137ed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converting VIF {"id": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "address": "fa:16:3e:1e:9f:9b", "network": {"id": "63011f76-2ab0-4a0e-9d43-94747467a951", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1729765544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed24e21a3624f4e8a4311728ff1c9f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e886f15-18", "ovs_interfaceid": "5e886f15-1894-41a0-a44e-ce2f8b748af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:9f:9b,bridge_name='br-int',has_traffic_filtering=True,id=5e886f15-1894-41a0-a44e-ce2f8b748af7,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e886f15-18') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG os_vif [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:9f:9b,bridge_name='br-int',has_traffic_filtering=True,id=5e886f15-1894-41a0-a44e-ce2f8b748af7,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e886f15-18') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e886f15-18, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:14:44 user nova-compute[73476]: INFO os_vif [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:9f:9b,bridge_name='br-int',has_traffic_filtering=True,id=5e886f15-1894-41a0-a44e-ce2f8b748af7,network=Network(63011f76-2ab0-4a0e-9d43-94747467a951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e886f15-18')
Aug 26 21:14:44 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Deleting instance files /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4_del
Aug 26 21:14:44 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Deletion of /opt/stack/data/nova/instances/4ed0ca87-528c-4712-9445-8cce12137ed4_del complete
Aug 26 21:14:44 user nova-compute[73476]: INFO nova.compute.manager [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 26 21:14:44 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:14:44 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:14:45 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Took 1.00 seconds to deallocate network for instance.
Aug 26 21:14:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-b80a4185-8975-448e-a152-2db3afad4427 req-c8dd7359-3046-46c8-a5a0-3e47b02fc52c service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received event network-vif-deleted-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:45 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Deleted allocations for instance 4ed0ca87-528c-4712-9445-8cce12137ed4
Aug 26 21:14:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-9ea2eb6f-704c-4d50-b2fa-b61ea2e18c94 tempest-AttachVolumeTestJSON-359578438 tempest-AttachVolumeTestJSON-359578438-project-member] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.163s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ff508e7-df44-493a-aff9-5161c599c634 req-8671f611-9573-4b99-8ad6-42b6cf289cd3 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received event network-vif-plugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ff508e7-df44-493a-aff9-5161c599c634 req-8671f611-9573-4b99-8ad6-42b6cf289cd3 service nova] Acquiring lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ff508e7-df44-493a-aff9-5161c599c634 req-8671f611-9573-4b99-8ad6-42b6cf289cd3 service nova] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9ff508e7-df44-493a-aff9-5161c599c634 req-8671f611-9573-4b99-8ad6-42b6cf289cd3 service nova] Lock "4ed0ca87-528c-4712-9445-8cce12137ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:45 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ff508e7-df44-493a-aff9-5161c599c634 req-8671f611-9573-4b99-8ad6-42b6cf289cd3 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] No waiting events found dispatching network-vif-plugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:14:45 user nova-compute[73476]: WARNING nova.compute.manager [req-9ff508e7-df44-493a-aff9-5161c599c634 req-8671f611-9573-4b99-8ad6-42b6cf289cd3 service nova] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Received unexpected event network-vif-plugged-5e886f15-1894-41a0-a44e-ce2f8b748af7 for instance with vm_state deleted and task_state None.
Aug 26 21:14:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-e923c49a-5815-46be-8c53-acc8d08cf326 req-73282081-4638-47bf-885d-55da21a0bfdb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received event network-changed-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:14:47 user nova-compute[73476]: DEBUG nova.compute.manager [req-e923c49a-5815-46be-8c53-acc8d08cf326 req-73282081-4638-47bf-885d-55da21a0bfdb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Refreshing instance network info cache due to event network-changed-0a217bac-0b90-4df1-96d6-ea44bea62d9e. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:14:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e923c49a-5815-46be-8c53-acc8d08cf326 req-73282081-4638-47bf-885d-55da21a0bfdb service nova] Acquiring lock "refresh_cache-be98156a-6391-4191-b33b-699b60241f2f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:14:47 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e923c49a-5815-46be-8c53-acc8d08cf326 req-73282081-4638-47bf-885d-55da21a0bfdb service nova] Acquired lock "refresh_cache-be98156a-6391-4191-b33b-699b60241f2f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:14:47 user nova-compute[73476]: DEBUG nova.network.neutron [req-e923c49a-5815-46be-8c53-acc8d08cf326 req-73282081-4638-47bf-885d-55da21a0bfdb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Refreshing network info cache for port 0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-e923c49a-5815-46be-8c53-acc8d08cf326 req-73282081-4638-47bf-885d-55da21a0bfdb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Updated VIF entry in instance network info cache for port 0a217bac-0b90-4df1-96d6-ea44bea62d9e. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG nova.network.neutron [req-e923c49a-5815-46be-8c53-acc8d08cf326 req-73282081-4638-47bf-885d-55da21a0bfdb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Updating instance_info_cache with network_info: [{"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e923c49a-5815-46be-8c53-acc8d08cf326 req-73282081-4638-47bf-885d-55da21a0bfdb service nova] Releasing lock "refresh_cache-be98156a-6391-4191-b33b-699b60241f2f" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "be98156a-6391-4191-b33b-699b60241f2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "be98156a-6391-4191-b33b-699b60241f2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "be98156a-6391-4191-b33b-699b60241f2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:48 user nova-compute[73476]: INFO nova.compute.manager [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Terminating instance
Aug 26 21:14:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:48 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: be98156a-6391-4191-b33b-699b60241f2f] Instance destroyed successfully.
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.objects.instance [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'resources' on Instance uuid be98156a-6391-4191-b33b-699b60241f2f {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-627608153',display_name='tempest-TestVolumeBootPattern-server-627608153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-627608153',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp0nGdKWqt25Vovv//zECtWPkdETKJV26I8dVi13Vaw97KRWRRvyx63r4FOvfGKO/4n655MVUFeORvL2Dj2aVlVmOVr7QUBY9FdJPdc/33XGtLV0TAuage04axfNiAeSg==',key_name='tempest-TestVolumeBootPattern-1669868756',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:13:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-0p25pgn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:13:21Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=be98156a-6391-4191-b33b-699b60241f2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "address": "fa:16:3e:15:12:63", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a217bac-0b", "ovs_interfaceid": "0a217bac-0b90-4df1-96d6-ea44bea62d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:12:63,bridge_name='br-int',has_traffic_filtering=True,id=0a217bac-0b90-4df1-96d6-ea44bea62d9e,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a217bac-0b') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_vif [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:12:63,bridge_name='br-int',has_traffic_filtering=True,id=0a217bac-0b90-4df1-96d6-ea44bea62d9e,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a217bac-0b') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a217bac-0b, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:14:49 user nova-compute[73476]: INFO os_vif [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:12:63,bridge_name='br-int',has_traffic_filtering=True,id=0a217bac-0b90-4df1-96d6-ea44bea62d9e,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a217bac-0b')
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcZJKLou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:14:49 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4e2fc3-3047-482e-a745-e90a9ff833b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0001d2a2-44b0-491c-880c-bb622c7a8d93]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:49 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:14:49 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258cfc60e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d251e4-940e-49b7-8b07-33a4d377a5db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e38db2-dafc-4149-82cd-5bae1464a04a]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c0f0c-ec52-49d4-ab0a-ab7152f94a61]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1d1fce-0e7b-45be-9c99-2e3a19a5e535]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26630636135333931', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_88be1d7a', '/dev/disk/by-id/scsi-1SCST_BIO88be1d7a-f0ca53913feb6bcb') {{(pid=84820) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f28baa-9b1c-46a6-9e2a-b959566224bd]: (4, None) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c976400-bdd2-4a6a-97b9-c5bb199188d9]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[24453f1c-8475-4ebc-9f4d-bcdbecba3010]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260]
Aug 26 21:14:49 user nova-compute[73476]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260] successful.
Aug 26 21:14:49 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c00ada-6428-4b96-aae3-f4f32c8e74f4]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== disconnect_volume: return (258ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:14:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Deleting instance files /opt/stack/data/nova/instances/be98156a-6391-4191-b33b-699b60241f2f_del
Aug 26 21:14:49 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Deletion of /opt/stack/data/nova/instances/be98156a-6391-4191-b33b-699b60241f2f_del complete
Aug 26 21:14:49 user nova-compute[73476]: INFO nova.compute.manager [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: be98156a-6391-4191-b33b-699b60241f2f] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: be98156a-6391-4191-b33b-699b60241f2f] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received event network-vif-unplugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] Acquiring lock "be98156a-6391-4191-b33b-699b60241f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] No waiting events found dispatching network-vif-unplugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received event network-vif-unplugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received event network-vif-plugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] Acquiring lock "be98156a-6391-4191-b33b-699b60241f2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] Lock "be98156a-6391-4191-b33b-699b60241f2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:49 user nova-compute[73476]: DEBUG nova.compute.manager [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] No waiting events found dispatching network-vif-plugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:14:49 user nova-compute[73476]: WARNING nova.compute.manager [req-77093d30-14a2-4baa-b19b-46db97c2f646 req-a793be6e-963b-4116-82f4-c94964e4baeb service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received unexpected event network-vif-plugged-0a217bac-0b90-4df1-96d6-ea44bea62d9e for instance with vm_state active and task_state deleting.
Aug 26 21:14:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-08f5332b-f64b-47ce-81a5-10fa168d8d8a req-de39ae62-60f7-42e8-a43d-59235911a500 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received event network-changed-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:14:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-08f5332b-f64b-47ce-81a5-10fa168d8d8a req-de39ae62-60f7-42e8-a43d-59235911a500 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Refreshing instance network info cache due to event network-changed-3b56baf2-efe1-4b87-93f1-a6619ac34787. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:14:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-08f5332b-f64b-47ce-81a5-10fa168d8d8a req-de39ae62-60f7-42e8-a43d-59235911a500 service nova] Acquiring lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:14:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-08f5332b-f64b-47ce-81a5-10fa168d8d8a req-de39ae62-60f7-42e8-a43d-59235911a500 service nova] Acquired lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:14:50 user nova-compute[73476]: DEBUG nova.network.neutron [req-08f5332b-f64b-47ce-81a5-10fa168d8d8a req-de39ae62-60f7-42e8-a43d-59235911a500 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Refreshing network info cache for port 3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:14:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:14:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:14:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:51 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: be98156a-6391-4191-b33b-699b60241f2f] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:14:51 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: be98156a-6391-4191-b33b-699b60241f2f] Took 1.65 seconds to deallocate network for instance.
Aug 26 21:14:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-08f5332b-f64b-47ce-81a5-10fa168d8d8a req-de39ae62-60f7-42e8-a43d-59235911a500 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Updated VIF entry in instance network info cache for port 3b56baf2-efe1-4b87-93f1-a6619ac34787. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:14:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-08f5332b-f64b-47ce-81a5-10fa168d8d8a req-de39ae62-60f7-42e8-a43d-59235911a500 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Updating instance_info_cache with network_info: [{"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:14:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-08f5332b-f64b-47ce-81a5-10fa168d8d8a req-de39ae62-60f7-42e8-a43d-59235911a500 service nova] Releasing lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:14:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:14:51 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:14:51 user nova-compute[73476]: DEBUG nova.compute.manager [req-9ce50a8d-1d44-4493-b0da-73ad261010bb req-8b5e91a1-6192-4582-9647-b7b80265ff49 service nova] [instance: be98156a-6391-4191-b33b-699b60241f2f] Received event network-vif-deleted-0a217bac-0b90-4df1-96d6-ea44bea62d9e {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:14:52 user nova-compute[73476]: INFO nova.compute.manager [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: be98156a-6391-4191-b33b-699b60241f2f] Took 0.84 seconds to detach 1 volumes for instance.
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:52 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Deleted allocations for instance be98156a-6391-4191-b33b-699b60241f2f
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "95313732-78dd-4689-b752-ae095d803408" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG nova.objects.instance [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lazy-loading 'flavor' on Instance uuid 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b63226cf-e44f-4bbc-9c50-90f84fc88c67 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "be98156a-6391-4191-b33b-699b60241f2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.917s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "95313732-78dd-4689-b752-ae095d803408" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:52 user nova-compute[73476]: INFO nova.compute.manager [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Attaching volume c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 to /dev/vdb
Aug 26 21:14:52 user nova-compute[73476]: DEBUG os_brick.utils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efde293-ead9-4e26-9ae6-9a2b565c8f23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13356d-7705-4f3d-983c-3a123c006503]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a786ffdd-07f2-45bb-bcea-9a43f79b0305]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ebf7b6-3a0a-49b5-9116-5230cb3d7ff5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:14:52 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:14:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f6a671-ef51-45fb-ae39-a470d47a6a24]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG os_brick.utils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:14:52 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Updating existing volume attachment record: 4841ac59-a9fe-49fe-8cc9-f36e645898d5 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:14:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:55 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:14:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:14:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:14:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:14:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:14:57 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:14:57 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Updating instance_info_cache with network_info: [{"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:58 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084484.191413, 4ed0ca87-528c-4712-9445-8cce12137ed4 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:14:59 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] VM Stopped (Lifecycle Event)
Aug 26 21:14:59 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-957e9b25-2ffa-4526-91b1-ca2495890765 None None] [instance: 4ed0ca87-528c-4712-9445-8cce12137ed4] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:14:59 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:14:59 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:14:59 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=25.130516052246094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 95313732-78dd-4689-b752-ae095d803408 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:14:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcLFUuki', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:15:03 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:15:03 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:15:03 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6458e81d-a920-4a13-ac73-f9e807e423d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:15:03 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a357fdbd-6e83-418e-999e-dcbcffffb5bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4] added
Aug 26 21:15:03 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[666ac79d-871e-4d4b-8c5a-de7164bbd10c]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aac03b8-2804-48e9-9c44-a26a0516b08b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TcLFUuki {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TcLFUuki" returned: 0 in 0.030s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d7d7cf-5c0d-43fd-b319-81a1337b7bd8]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TcLFUuki'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e330890e-137a-4a61-b796-51df960fde9e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ef2c2c-26ed-4f23-b2c5-9b65bba04afd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 21:15:03 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 21:15:03 user nova-compute[73476]:  {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:15:03 user nova-compute[73476]: WARNING os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 21:15:03 user nova-compute[73476]: 
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[818049e2-e4cc-434a-86b3-06b4a5ff6531]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4, portal: 172.16.0.220,3260]
Aug 26 21:15:03 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4, portal: 172.16.0.220,3260] successful.
Aug 26 21:15:03 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e4619-2901-4974-921a-2186ca1e6024]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[39652be3-2c12-4fdb-809b-8daf526d8bdd]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:03 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:03 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6130ae0f-a1e2-4ff6-9779-37bbd574399d]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:15:03 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcLFUuki', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084489.1712315, be98156a-6391-4191-b33b-699b60241f2f => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:15:04 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: be98156a-6391-4191-b33b-699b60241f2f] VM Stopped (Lifecycle Event)
Aug 26 21:15:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-9dbecc46-e24a-4cb8-8459-c3e5209f183a None None] [instance: be98156a-6391-4191-b33b-699b60241f2f] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26236613164323935', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236613164323935', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG nova.objects.instance [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lazy-loading 'flavor' on Instance uuid 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:15:04 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:15:04 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 21:15:04 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:15:04 user nova-compute[73476]:   <serial>c3b48ab1-9d70-4a43-8539-2e4ecde15cf4</serial>
Aug 26 21:15:04 user nova-compute[73476]: </disk>
Aug 26 21:15:04 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:15:04 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] No VIF found with MAC fa:16:3e:7f:97:3a, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:15:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-c03ca953-af4b-4c77-aee9-e03e5a2c3c93 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.420s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:07 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:15:07 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:15:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "95313732-78dd-4689-b752-ae095d803408" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:15:07 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.007s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG nova.objects.instance [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lazy-loading 'flavor' on Instance uuid 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "95313732-78dd-4689-b752-ae095d803408" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:15:08 user nova-compute[73476]: INFO nova.compute.manager [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Attaching volume 3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 to /dev/vdc
Aug 26 21:15:08 user nova-compute[73476]: DEBUG os_brick.utils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3f72a3-e3e4-43ae-8a39-cb3f88451115]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[882a62e8-0288-4a94-b29a-8e84b73e18d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea49004-9b21-4253-b8cf-7d87faad0983]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[78283fac-361e-4d8a-922e-0e52e84ae8a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:15:08 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:15:08 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ae2d2d-b662-4877-ba5c-883ec744d276]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG os_brick.utils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:15:08 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Updating existing volume attachment record: 7d9bb562-a569-49bd-be10-ee7ed149dae3 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:15:09 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOpfwshK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:15:18 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:15:18 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:15:18 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6f8c20-261c-4146-8547-e64762171605]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:15:18 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f4d9e1-d391-413c-8304-7f6103019780]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2] added
Aug 26 21:15:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eff5c3-9a9e-4571-92ba-134f66241b0a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f49e37-4b65-4779-b294-fc2650c0735f]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOpfwshK {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOpfwshK" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b802b7-49a4-40c9-aec4-c3165f967e10]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cOpfwshK'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2daad3-0104-45f0-b49b-d60446a2080e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[af42c79f-c767-4b8b-ab1f-559a973f8c67]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[448ff18a-0aa7-4e33-8705-d85b62d2f8c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2, portal: 172.16.0.220,3260]
Aug 26 21:15:18 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2, portal: 172.16.0.220,3260] successful.
Aug 26 21:15:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d1a767-bfba-4deb-8372-433545754bed]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[131ba42c-a833-435e-9e6a-c32afd95bbf4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:18 user nova-compute[73476]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 (non-flash)
Aug 26 21:15:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:18 user nova-compute[73476]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 (non-flash)
Aug 26 21:15:18 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48938cf-b332-4ec5-852b-a8caba30fb4e]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:18 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:15:19 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:19 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:15:19 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOpfwshK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:15:19 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:15:19 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23266616665386339', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:15:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266616665386339', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:15:19 user nova-compute[73476]: DEBUG nova.objects.instance [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lazy-loading 'flavor' on Instance uuid 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:15:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:15:19 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:15:19 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:15:19 user nova-compute[73476]:   <target dev="vdc" bus="virtio"/>
Aug 26 21:15:19 user nova-compute[73476]:   <serial>3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2</serial>
Aug 26 21:15:19 user nova-compute[73476]: </disk>
Aug 26 21:15:19 user nova-compute[73476]:  {{(pid=73476) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:15:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:15:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:15:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:15:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] No VIF found with MAC fa:16:3e:7f:97:3a, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:15:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-8d9b65cf-8105-4bdb-b9dd-b020525b42ab tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.285s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "95313732-78dd-4689-b752-ae095d803408" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:15:21 user nova-compute[73476]: INFO nova.compute.manager [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Detaching volume 3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2
Aug 26 21:15:21 user nova-compute[73476]: INFO nova.virt.block_device [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Attempting to driver detach volume 3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 from mountpoint /dev/vdc
Aug 26 21:15:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Attempting to detach device vdc from instance 95313732-78dd-4689-b752-ae095d803408 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:15:21 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:15:21 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:15:21 user nova-compute[73476]:   <target dev="vdc" bus="virtio"/>
Aug 26 21:15:21 user nova-compute[73476]:   <serial>3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2</serial>
Aug 26 21:15:21 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 21:15:21 user nova-compute[73476]: </disk>
Aug 26 21:15:21 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:15:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Successfully detached device vdc from instance 95313732-78dd-4689-b752-ae095d803408 from the persistent domain config.
Aug 26 21:15:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 95313732-78dd-4689-b752-ae095d803408 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:15:21 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:15:21 user nova-compute[73476]:   <source dev="/dev/sdc"/>
Aug 26 21:15:21 user nova-compute[73476]:   <target dev="vdc" bus="virtio"/>
Aug 26 21:15:21 user nova-compute[73476]:   <serial>3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2</serial>
Aug 26 21:15:21 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 21:15:21 user nova-compute[73476]: </disk>
Aug 26 21:15:21 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693084521.7450118, 95313732-78dd-4689-b752-ae095d803408 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:15:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Successfully detached device vdc from instance 95313732-78dd-4689-b752-ae095d803408 from the live domain config.
Aug 26 21:15:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOpfwshK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:15:21 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8b74ab-b986-4532-a0dc-03dd535b4dad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad5778-244c-445c-a0ff-da05f0ace366]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:21 user nova-compute[73476]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 (non-flash)
Aug 26 21:15:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:21 user nova-compute[73476]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 (non-flash)
Aug 26 21:15:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258cf30280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[98140502-f63a-43ab-be40-f8f56abfe6b8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3806c860-b410-4125-8503-3edc92a7612a]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c98535a-6ea0-477a-bc27-797cc5892778]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca0e7c2-47a6-4409-bac2-2d86526cfb3a]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[79af9045-531b-4f14-a33f-45192a675a31]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f7c711-2641-4211-b689-387e2b6f5031]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2, portal: 172.16.0.220,3260]
Aug 26 21:15:21 user nova-compute[73476]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2, portal: 172.16.0.220,3260] successful.
Aug 26 21:15:21 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:21 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:22 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e646d4a-fcba-4e23-a03b-2a6ec9dbd9e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:22 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3b66b8-984f-4ad5-be9c-e87ed7cb825b]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:15:22 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] <== disconnect_volume: return (259ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:15:22 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:15:22 user nova-compute[73476]: DEBUG nova.objects.instance [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lazy-loading 'flavor' on Instance uuid 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:15:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-b3c05c6a-d1a6-4c31-b196-ed7cdeb386e1 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:24 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:15:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:29 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:34 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:15:40 user nova-compute[73476]: INFO nova.compute.claims [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Claim successful on node user
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:15:40 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.policy [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bb1fc1180d34eb0ae98c52187aae87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1962b32d78d4f6da29bb0fdaa001363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:15:40 user nova-compute[73476]: INFO nova.virt.block_device [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Booting with volume a1edaf07-8b67-473a-b42c-800fffb2379d at /dev/vda
Aug 26 21:15:40 user nova-compute[73476]: DEBUG os_brick.utils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5a9edb-642f-4702-9db7-3a52dd4c1398]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c478dfeb-936c-4080-8c7a-a6723dbcb35f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1687b665-9c46-4951-9eca-199cb05428af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6130d4f4-9cd1-44df-8d9a-d42d068a0404]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:15:40 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:15:40 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[990091e5-cf05-4d65-86b9-983bb9dc81d6]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG os_brick.utils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:15:40 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updating existing volume attachment record: 39c9cfd6-d722-4bd4-915a-3b640936edd1 {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:15:41 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Successfully created port: dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Successfully updated port: dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquired lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG nova.compute.manager [req-81b74f0b-79c6-403f-ac8c-c0dab4f842f1 req-2dba4d16-08e1-4c18-abc1-21bc2592ed2e service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received event network-changed-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG nova.compute.manager [req-81b74f0b-79c6-403f-ac8c-c0dab4f842f1 req-2dba4d16-08e1-4c18-abc1-21bc2592ed2e service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Refreshing instance network info cache due to event network-changed-dd8613d1-ea36-4a21-be5e-298277e66668. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-81b74f0b-79c6-403f-ac8c-c0dab4f842f1 req-2dba4d16-08e1-4c18-abc1-21bc2592ed2e service nova] Acquiring lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG nova.network.neutron [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updating instance_info_cache with network_info: [{"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Releasing lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Instance network_info: |[{"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-81b74f0b-79c6-403f-ac8c-c0dab4f842f1 req-2dba4d16-08e1-4c18-abc1-21bc2592ed2e service nova] Acquired lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:15:42 user nova-compute[73476]: DEBUG nova.network.neutron [req-81b74f0b-79c6-403f-ac8c-c0dab4f842f1 req-2dba4d16-08e1-4c18-abc1-21bc2592ed2e service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Refreshing network info cache for port dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:15:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-81b74f0b-79c6-403f-ac8c-c0dab4f842f1 req-2dba4d16-08e1-4c18-abc1-21bc2592ed2e service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updated VIF entry in instance network info cache for port dd8613d1-ea36-4a21-be5e-298277e66668. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:15:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-81b74f0b-79c6-403f-ac8c-c0dab4f842f1 req-2dba4d16-08e1-4c18-abc1-21bc2592ed2e service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updating instance_info_cache with network_info: [{"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:15:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-81b74f0b-79c6-403f-ac8c-c0dab4f842f1 req-2dba4d16-08e1-4c18-abc1-21bc2592ed2e service nova] Releasing lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:15:44 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:15:49 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:15:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:15:51 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Creating image(s)
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Ensure instance console log exists: /opt/stack/data/nova/instances/516bc7a5-b90d-4a09-ab6b-1128a88a3afe/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Start _get_guest_xml network_info=[{"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '39c9cfd6-d722-4bd4-915a-3b640936edd1', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcZJKLou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '516bc7a5-b90d-4a09-ab6b-1128a88a3afe', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1edaf07-8b67-473a-b42c-800fffb2379d', 'serial': 'a1edaf07-8b67-473a-b42c-800fffb2379d'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:15:51 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:15:51 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcZJKLou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:15:51 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:15:51 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:15:51 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3913a4-9d90-4c63-8820-de2bd4ce7f61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:15:51 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda9ae3-680b-41ef-867a-19336474c2c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d] added
Aug 26 21:15:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc06e99-3604-41e7-be8e-a1432f0efd6d]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd709e3-ae23-47c6-9cdc-d9231f4e2d39]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcZJKLou {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcZJKLou" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9348cb31-dbed-4d83-8ffb-7062fd973498]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tcZJKLou'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb87a17c-e477-48e9-a32f-0950f14022f6]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c3ad50-a050-4b09-b8a8-f82fd5044fc8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:51 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:15:51 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6e6577-46be-4c70-96ff-a44f60a9bedd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260]
Aug 26 21:15:52 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260] successful.
Aug 26 21:15:52 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0054c7d2-ef36-4e77-981e-54de36eb3d08]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe164424-2890-4693-acba-4501a6be3a7a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:52 user nova-compute[73476]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:15:52 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:15:52 user nova-compute[73476]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:15:52 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcabe402-fcbd-4242-9b97-abf90fe7dc3f]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcZJKLou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:15:52 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26630636135333931', 'path': '/dev/sdc'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630636135333931', 'path': '/dev/sdc'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-242795097',display_name='tempest-TestVolumeBootPattern-server-242795097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-242795097',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp0nGdKWqt25Vovv//zECtWPkdETKJV26I8dVi13Vaw97KRWRRvyx63r4FOvfGKO/4n655MVUFeORvL2Dj2aVlVmOVr7QUBY9FdJPdc/33XGtLV0TAuage04axfNiAeSg==',key_name='tempest-TestVolumeBootPattern-1669868756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-fxa08yjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:15:41Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=516bc7a5-b90d-4a09-ab6b-1128a88a3afe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=dd8613d1-ea36-4a21-be5e-298277e66668,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8613d1-ea') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'pci_devices' on Instance uuid 516bc7a5-b90d-4a09-ab6b-1128a88a3afe {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:15:53 user nova-compute[73476]:   <uuid>516bc7a5-b90d-4a09-ab6b-1128a88a3afe</uuid>
Aug 26 21:15:53 user nova-compute[73476]:   <name>instance-00000032</name>
Aug 26 21:15:53 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:15:53 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:15:53 user nova-compute[73476]:   <metadata>
Aug 26 21:15:53 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:15:53 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:15:53 user nova-compute[73476]:       <nova:name>tempest-TestVolumeBootPattern-server-242795097</nova:name>
Aug 26 21:15:53 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:15:51</nova:creationTime>
Aug 26 21:15:53 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:15:53 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:15:53 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:15:53 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:15:53 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:15:53 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:15:53 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:15:53 user nova-compute[73476]:       <nova:owner>
Aug 26 21:15:53 user nova-compute[73476]:         <nova:user uuid="5bb1fc1180d34eb0ae98c52187aae87e">tempest-TestVolumeBootPattern-443030295-project-member</nova:user>
Aug 26 21:15:53 user nova-compute[73476]:         <nova:project uuid="a1962b32d78d4f6da29bb0fdaa001363">tempest-TestVolumeBootPattern-443030295</nova:project>
Aug 26 21:15:53 user nova-compute[73476]:       </nova:owner>
Aug 26 21:15:53 user nova-compute[73476]:       <nova:ports>
Aug 26 21:15:53 user nova-compute[73476]:         <nova:port uuid="dd8613d1-ea36-4a21-be5e-298277e66668">
Aug 26 21:15:53 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 21:15:53 user nova-compute[73476]:         </nova:port>
Aug 26 21:15:53 user nova-compute[73476]:       </nova:ports>
Aug 26 21:15:53 user nova-compute[73476]:     </nova:instance>
Aug 26 21:15:53 user nova-compute[73476]:   </metadata>
Aug 26 21:15:53 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:15:53 user nova-compute[73476]:     <system>
Aug 26 21:15:53 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:15:53 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:15:53 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:15:53 user nova-compute[73476]:       <entry name="serial">516bc7a5-b90d-4a09-ab6b-1128a88a3afe</entry>
Aug 26 21:15:53 user nova-compute[73476]:       <entry name="uuid">516bc7a5-b90d-4a09-ab6b-1128a88a3afe</entry>
Aug 26 21:15:53 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:15:53 user nova-compute[73476]:     </system>
Aug 26 21:15:53 user nova-compute[73476]:   </sysinfo>
Aug 26 21:15:53 user nova-compute[73476]:   <os>
Aug 26 21:15:53 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:15:53 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:15:53 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:15:53 user nova-compute[73476]:   </os>
Aug 26 21:15:53 user nova-compute[73476]:   <features>
Aug 26 21:15:53 user nova-compute[73476]:     <acpi/>
Aug 26 21:15:53 user nova-compute[73476]:     <apic/>
Aug 26 21:15:53 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:15:53 user nova-compute[73476]:   </features>
Aug 26 21:15:53 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:15:53 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:15:53 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:15:53 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:15:53 user nova-compute[73476]:   </clock>
Aug 26 21:15:53 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:15:53 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:15:53 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:15:53 user nova-compute[73476]:   </cpu>
Aug 26 21:15:53 user nova-compute[73476]:   <devices>
Aug 26 21:15:53 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 21:15:53 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:15:53 user nova-compute[73476]:       <source dev="/dev/sdc"/>
Aug 26 21:15:53 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:15:53 user nova-compute[73476]:       <serial>a1edaf07-8b67-473a-b42c-800fffb2379d</serial>
Aug 26 21:15:53 user nova-compute[73476]:     </disk>
Aug 26 21:15:53 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:15:53 user nova-compute[73476]:       <mac address="fa:16:3e:a0:b1:32"/>
Aug 26 21:15:53 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:15:53 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:15:53 user nova-compute[73476]:       <target dev="tapdd8613d1-ea"/>
Aug 26 21:15:53 user nova-compute[73476]:     </interface>
Aug 26 21:15:53 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:15:53 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/516bc7a5-b90d-4a09-ab6b-1128a88a3afe/console.log" append="off"/>
Aug 26 21:15:53 user nova-compute[73476]:     </serial>
Aug 26 21:15:53 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:15:53 user nova-compute[73476]:     <video>
Aug 26 21:15:53 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:15:53 user nova-compute[73476]:     </video>
Aug 26 21:15:53 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:15:53 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:15:53 user nova-compute[73476]:     </rng>
Aug 26 21:15:53 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:15:53 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:15:53 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:15:53 user nova-compute[73476]:     </memballoon>
Aug 26 21:15:53 user nova-compute[73476]:   </devices>
Aug 26 21:15:53 user nova-compute[73476]: </domain>
Aug 26 21:15:53 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-242795097',display_name='tempest-TestVolumeBootPattern-server-242795097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-242795097',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp0nGdKWqt25Vovv//zECtWPkdETKJV26I8dVi13Vaw97KRWRRvyx63r4FOvfGKO/4n655MVUFeORvL2Dj2aVlVmOVr7QUBY9FdJPdc/33XGtLV0TAuage04axfNiAeSg==',key_name='tempest-TestVolumeBootPattern-1669868756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-fxa08yjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:15:41Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=516bc7a5-b90d-4a09-ab6b-1128a88a3afe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=dd8613d1-ea36-4a21-be5e-298277e66668,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8613d1-ea') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG os_vif [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=dd8613d1-ea36-4a21-be5e-298277e66668,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8613d1-ea') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd8613d1-ea, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd8613d1-ea, col_values=(('external_ids', {'iface-id': 'dd8613d1-ea36-4a21-be5e-298277e66668', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:b1:32', 'vm-uuid': '516bc7a5-b90d-4a09-ab6b-1128a88a3afe'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:53 user nova-compute[73476]: INFO os_vif [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=dd8613d1-ea36-4a21-be5e-298277e66668,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8613d1-ea')
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:15:53 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No VIF found with MAC fa:16:3e:a0:b1:32, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:15:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:54 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-d99f4b50-f2c9-4cf8-99d5-a04e2a317d54 req-d822b6ba-deb9-45b9-a485-e7608b7eb9e2 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received event network-vif-plugged-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:15:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d99f4b50-f2c9-4cf8-99d5-a04e2a317d54 req-d822b6ba-deb9-45b9-a485-e7608b7eb9e2 service nova] Acquiring lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:15:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d99f4b50-f2c9-4cf8-99d5-a04e2a317d54 req-d822b6ba-deb9-45b9-a485-e7608b7eb9e2 service nova] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:15:54 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-d99f4b50-f2c9-4cf8-99d5-a04e2a317d54 req-d822b6ba-deb9-45b9-a485-e7608b7eb9e2 service nova] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:54 user nova-compute[73476]: DEBUG nova.compute.manager [req-d99f4b50-f2c9-4cf8-99d5-a04e2a317d54 req-d822b6ba-deb9-45b9-a485-e7608b7eb9e2 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] No waiting events found dispatching network-vif-plugged-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:15:54 user nova-compute[73476]: WARNING nova.compute.manager [req-d99f4b50-f2c9-4cf8-99d5-a04e2a317d54 req-d822b6ba-deb9-45b9-a485-e7608b7eb9e2 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received unexpected event network-vif-plugged-dd8613d1-ea36-4a21-be5e-298277e66668 for instance with vm_state building and task_state spawning.
Aug 26 21:15:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084556.6341698, 516bc7a5-b90d-4a09-ab6b-1128a88a3afe => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:15:56 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] VM Resumed (Lifecycle Event)
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:15:56 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Instance spawned successfully.
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:15:56 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084556.6412325, 516bc7a5-b90d-4a09-ab6b-1128a88a3afe => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:15:56 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] VM Started (Lifecycle Event)
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:15:56 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:15:56 user nova-compute[73476]: INFO nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.compute.manager [req-5d1c8d3f-60e9-4f57-9005-5d9a863077b9 req-4a15b456-58ea-4562-9c2f-0aa06a7bc36c service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received event network-vif-plugged-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5d1c8d3f-60e9-4f57-9005-5d9a863077b9 req-4a15b456-58ea-4562-9c2f-0aa06a7bc36c service nova] Acquiring lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5d1c8d3f-60e9-4f57-9005-5d9a863077b9 req-4a15b456-58ea-4562-9c2f-0aa06a7bc36c service nova] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-5d1c8d3f-60e9-4f57-9005-5d9a863077b9 req-4a15b456-58ea-4562-9c2f-0aa06a7bc36c service nova] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:56 user nova-compute[73476]: DEBUG nova.compute.manager [req-5d1c8d3f-60e9-4f57-9005-5d9a863077b9 req-4a15b456-58ea-4562-9c2f-0aa06a7bc36c service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] No waiting events found dispatching network-vif-plugged-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:15:56 user nova-compute[73476]: WARNING nova.compute.manager [req-5d1c8d3f-60e9-4f57-9005-5d9a863077b9 req-4a15b456-58ea-4562-9c2f-0aa06a7bc36c service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received unexpected event network-vif-plugged-dd8613d1-ea36-4a21-be5e-298277e66668 for instance with vm_state building and task_state spawning.
Aug 26 21:15:56 user nova-compute[73476]: INFO nova.compute.manager [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Took 16.68 seconds to build instance.
Aug 26 21:15:56 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f93e84a5-a23c-49fa-8e75-2aaeedee5cf1 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.786s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:15:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:15:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:58 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:15:58 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:15:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:15:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:15:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:15:58 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:15:58 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:15:58 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:15:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Updating instance_info_cache with network_info: [{"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:15:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-95313732-78dd-4689-b752-ae095d803408" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:15:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:15:59 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:16:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:00 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:16:01 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:16:01 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=25.119586944580078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 95313732-78dd-4689-b752-ae095d803408 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 516bc7a5-b90d-4a09-ab6b-1128a88a3afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:16:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:04 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:07 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:16:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:16:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:16:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:16:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:08 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:09 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "95313732-78dd-4689-b752-ae095d803408" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:11 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:11 user nova-compute[73476]: INFO nova.compute.manager [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Detaching volume c3b48ab1-9d70-4a43-8539-2e4ecde15cf4
Aug 26 21:16:11 user nova-compute[73476]: INFO nova.virt.block_device [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Attempting to driver detach volume c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 from mountpoint /dev/vdb
Aug 26 21:16:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Attempting to detach device vdb from instance 95313732-78dd-4689-b752-ae095d803408 from the persistent domain config. {{(pid=73476) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:16:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:16:11 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:16:11 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 21:16:11 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:16:11 user nova-compute[73476]:   <serial>c3b48ab1-9d70-4a43-8539-2e4ecde15cf4</serial>
Aug 26 21:16:11 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:16:11 user nova-compute[73476]: </disk>
Aug 26 21:16:11 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:16:11 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Successfully detached device vdb from instance 95313732-78dd-4689-b752-ae095d803408 from the persistent domain config.
Aug 26 21:16:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95313732-78dd-4689-b752-ae095d803408 from the live domain config. {{(pid=73476) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:16:11 user nova-compute[73476]: DEBUG nova.virt.libvirt.guest [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:16:11 user nova-compute[73476]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:16:11 user nova-compute[73476]:   <source dev="/dev/sdb"/>
Aug 26 21:16:11 user nova-compute[73476]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:16:11 user nova-compute[73476]:   <serial>c3b48ab1-9d70-4a43-8539-2e4ecde15cf4</serial>
Aug 26 21:16:11 user nova-compute[73476]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:16:11 user nova-compute[73476]: </disk>
Aug 26 21:16:11 user nova-compute[73476]:  {{(pid=73476) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Received event <DeviceRemovedEvent: 1693084572.2658613, 95313732-78dd-4689-b752-ae095d803408 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73476) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:16:12 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Successfully detached device vdb from instance 95313732-78dd-4689-b752-ae095d803408 from the live domain config.
Aug 26 21:16:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcLFUuki', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:16:12 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[209a1f48-73e8-4522-a679-ae0029f4e35e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd96b71-60bc-475e-a573-54182f63db3e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:16:12 user nova-compute[73476]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:16:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 (non-flash)
Aug 26 21:16:12 user nova-compute[73476]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:16:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258ce44a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c83191a-4297-40ca-82da-50036cac16c1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9b3378-e543-4c75-a236-f4f0a263cf77]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a03c8b0-4ddf-4758-93f7-b638f9c1db89]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a12b87e-9da6-4297-99bb-0a090fb7ab72]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4a2c45-874f-4dd2-904d-306b480f2b07]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2be5e8-f117-4a18-98d2-8ec576824e99]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4, portal: 172.16.0.220,3260]
Aug 26 21:16:12 user nova-compute[73476]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4, portal: 172.16.0.220,3260] successful.
Aug 26 21:16:12 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b48ab1-9d70-4a43-8539-2e4ecde15cf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e595bfb-9a52-4bcb-9737-4b4748810f6a]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] <== disconnect_volume: return (272ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:16:12 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:16:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:13 user nova-compute[73476]: DEBUG nova.objects.instance [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lazy-loading 'flavor' on Instance uuid 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:16:13 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-a58a4be3-f68a-4b4a-8096-25d6c37c0054 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.698s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:14 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquiring lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:16:18 user nova-compute[73476]: INFO nova.compute.claims [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Claim successful on node user
Aug 26 21:16:18 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:18 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:16:19 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:16:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG nova.policy [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1a37c221387416aba4e3203d6c8e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf393885a64727844482ea968586a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:16:19 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Creating image(s)
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "/opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "/opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.189s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquiring lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.185s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk 1073741824 {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b,backing_fmt=raw /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk 1073741824" returned: 0 in 0.053s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "a15cca87b4abddb8c4031123e04e0d8dcae41b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG nova.network.neutron [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Successfully created port: 77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b --force-share --output=json" returned: 0 in 0.186s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk. size=1073741824 {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:16:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG nova.virt.disk.api [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Cannot resize image /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk to a smaller size. {{(pid=73476) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Created local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Ensure instance console log exists: /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG nova.network.neutron [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Successfully updated port: 77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquiring lock "refresh_cache-1b63ddc7-5f33-4d54-bac5-14c61df9fd49" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquired lock "refresh_cache-1b63ddc7-5f33-4d54-bac5-14c61df9fd49" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG nova.network.neutron [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-f12c361a-53cb-4dd4-84d5-51910653bc1e req-d4f33d64-e02b-431d-81e2-5df962e7cbcc service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received event network-changed-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG nova.compute.manager [req-f12c361a-53cb-4dd4-84d5-51910653bc1e req-d4f33d64-e02b-431d-81e2-5df962e7cbcc service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Refreshing instance network info cache due to event network-changed-77943e99-2a3d-4f61-ab54-96fa33409c53. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f12c361a-53cb-4dd4-84d5-51910653bc1e req-d4f33d64-e02b-431d-81e2-5df962e7cbcc service nova] Acquiring lock "refresh_cache-1b63ddc7-5f33-4d54-bac5-14c61df9fd49" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG nova.network.neutron [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:16:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.network.neutron [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Updating instance_info_cache with network_info: [{"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Releasing lock "refresh_cache-1b63ddc7-5f33-4d54-bac5-14c61df9fd49" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Instance network_info: |[{"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f12c361a-53cb-4dd4-84d5-51910653bc1e req-d4f33d64-e02b-431d-81e2-5df962e7cbcc service nova] Acquired lock "refresh_cache-1b63ddc7-5f33-4d54-bac5-14c61df9fd49" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.network.neutron [req-f12c361a-53cb-4dd4-84d5-51910653bc1e req-d4f33d64-e02b-431d-81e2-5df962e7cbcc service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Refreshing network info cache for port 77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Start _get_guest_xml network_info=[{"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '810a80fc-a1eb-411e-8c1f-b24c6f7ca436'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:16:21 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:16:21 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T20:37:48Z,direct_url=<?>,disk_format='qcow2',id=810a80fc-a1eb-411e-8c1f-b24c6f7ca436,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a5651794d8ac4f3286e58172df99c438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T20:37:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-337955748',display_name='tempest-VolumesActionsTest-instance-337955748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-337955748',id=51,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bf393885a64727844482ea968586a1',ramdisk_id='',reservation_id='r-p647is25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1478997525',owner_user_name='tempest-VolumesActionsTest-1478997525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:16:19Z,user_data=None,user_id='b1a37c221387416aba4e3203d6c8e053',uuid=1b63ddc7-5f33-4d54-bac5-14c61df9fd49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Converting VIF {"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:47:38,bridge_name='br-int',has_traffic_filtering=True,id=77943e99-2a3d-4f61-ab54-96fa33409c53,network=Network(fafbc887-687e-4470-8662-ff6089f6f3d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77943e99-2a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:16:21 user nova-compute[73476]:   <uuid>1b63ddc7-5f33-4d54-bac5-14c61df9fd49</uuid>
Aug 26 21:16:21 user nova-compute[73476]:   <name>instance-00000033</name>
Aug 26 21:16:21 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:16:21 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:16:21 user nova-compute[73476]:   <metadata>
Aug 26 21:16:21 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:16:21 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:16:21 user nova-compute[73476]:       <nova:name>tempest-VolumesActionsTest-instance-337955748</nova:name>
Aug 26 21:16:21 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:16:21</nova:creationTime>
Aug 26 21:16:21 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:16:21 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:16:21 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:16:21 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:16:21 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:16:21 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:16:21 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:16:21 user nova-compute[73476]:       <nova:owner>
Aug 26 21:16:21 user nova-compute[73476]:         <nova:user uuid="b1a37c221387416aba4e3203d6c8e053">tempest-VolumesActionsTest-1478997525-project-member</nova:user>
Aug 26 21:16:21 user nova-compute[73476]:         <nova:project uuid="92bf393885a64727844482ea968586a1">tempest-VolumesActionsTest-1478997525</nova:project>
Aug 26 21:16:21 user nova-compute[73476]:       </nova:owner>
Aug 26 21:16:21 user nova-compute[73476]:       <nova:root type="image" uuid="810a80fc-a1eb-411e-8c1f-b24c6f7ca436"/>
Aug 26 21:16:21 user nova-compute[73476]:       <nova:ports>
Aug 26 21:16:21 user nova-compute[73476]:         <nova:port uuid="77943e99-2a3d-4f61-ab54-96fa33409c53">
Aug 26 21:16:21 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 21:16:21 user nova-compute[73476]:         </nova:port>
Aug 26 21:16:21 user nova-compute[73476]:       </nova:ports>
Aug 26 21:16:21 user nova-compute[73476]:     </nova:instance>
Aug 26 21:16:21 user nova-compute[73476]:   </metadata>
Aug 26 21:16:21 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:16:21 user nova-compute[73476]:     <system>
Aug 26 21:16:21 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:16:21 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:16:21 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:16:21 user nova-compute[73476]:       <entry name="serial">1b63ddc7-5f33-4d54-bac5-14c61df9fd49</entry>
Aug 26 21:16:21 user nova-compute[73476]:       <entry name="uuid">1b63ddc7-5f33-4d54-bac5-14c61df9fd49</entry>
Aug 26 21:16:21 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:16:21 user nova-compute[73476]:     </system>
Aug 26 21:16:21 user nova-compute[73476]:   </sysinfo>
Aug 26 21:16:21 user nova-compute[73476]:   <os>
Aug 26 21:16:21 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:16:21 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:16:21 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:16:21 user nova-compute[73476]:   </os>
Aug 26 21:16:21 user nova-compute[73476]:   <features>
Aug 26 21:16:21 user nova-compute[73476]:     <acpi/>
Aug 26 21:16:21 user nova-compute[73476]:     <apic/>
Aug 26 21:16:21 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:16:21 user nova-compute[73476]:   </features>
Aug 26 21:16:21 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:16:21 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:16:21 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:16:21 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:16:21 user nova-compute[73476]:   </clock>
Aug 26 21:16:21 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:16:21 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:16:21 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:16:21 user nova-compute[73476]:   </cpu>
Aug 26 21:16:21 user nova-compute[73476]:   <devices>
Aug 26 21:16:21 user nova-compute[73476]:     <disk type="file" device="disk">
Aug 26 21:16:21 user nova-compute[73476]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:16:21 user nova-compute[73476]:       <source file="/opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk"/>
Aug 26 21:16:21 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:16:21 user nova-compute[73476]:     </disk>
Aug 26 21:16:21 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:16:21 user nova-compute[73476]:       <mac address="fa:16:3e:f8:47:38"/>
Aug 26 21:16:21 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:16:21 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:16:21 user nova-compute[73476]:       <target dev="tap77943e99-2a"/>
Aug 26 21:16:21 user nova-compute[73476]:     </interface>
Aug 26 21:16:21 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:16:21 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/console.log" append="off"/>
Aug 26 21:16:21 user nova-compute[73476]:     </serial>
Aug 26 21:16:21 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:16:21 user nova-compute[73476]:     <video>
Aug 26 21:16:21 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:16:21 user nova-compute[73476]:     </video>
Aug 26 21:16:21 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:16:21 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:16:21 user nova-compute[73476]:     </rng>
Aug 26 21:16:21 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:16:21 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:16:21 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:16:21 user nova-compute[73476]:     </memballoon>
Aug 26 21:16:21 user nova-compute[73476]:   </devices>
Aug 26 21:16:21 user nova-compute[73476]: </domain>
Aug 26 21:16:21 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-337955748',display_name='tempest-VolumesActionsTest-instance-337955748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-337955748',id=51,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bf393885a64727844482ea968586a1',ramdisk_id='',reservation_id='r-p647is25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1478997525',owner_user_name='tempest-VolumesActionsTest-1478997525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:16:19Z,user_data=None,user_id='b1a37c221387416aba4e3203d6c8e053',uuid=1b63ddc7-5f33-4d54-bac5-14c61df9fd49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Converting VIF {"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:47:38,bridge_name='br-int',has_traffic_filtering=True,id=77943e99-2a3d-4f61-ab54-96fa33409c53,network=Network(fafbc887-687e-4470-8662-ff6089f6f3d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77943e99-2a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG os_vif [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:47:38,bridge_name='br-int',has_traffic_filtering=True,id=77943e99-2a3d-4f61-ab54-96fa33409c53,network=Network(fafbc887-687e-4470-8662-ff6089f6f3d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77943e99-2a') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77943e99-2a, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77943e99-2a, col_values=(('external_ids', {'iface-id': '77943e99-2a3d-4f61-ab54-96fa33409c53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:47:38', 'vm-uuid': '1b63ddc7-5f33-4d54-bac5-14c61df9fd49'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:21 user nova-compute[73476]: INFO os_vif [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:47:38,bridge_name='br-int',has_traffic_filtering=True,id=77943e99-2a3d-4f61-ab54-96fa33409c53,network=Network(fafbc887-687e-4470-8662-ff6089f6f3d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77943e99-2a')
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] No VIF found with MAC fa:16:3e:f8:47:38, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.network.neutron [req-f12c361a-53cb-4dd4-84d5-51910653bc1e req-d4f33d64-e02b-431d-81e2-5df962e7cbcc service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Updated VIF entry in instance network info cache for port 77943e99-2a3d-4f61-ab54-96fa33409c53. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG nova.network.neutron [req-f12c361a-53cb-4dd4-84d5-51910653bc1e req-d4f33d64-e02b-431d-81e2-5df962e7cbcc service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Updating instance_info_cache with network_info: [{"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:16:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-f12c361a-53cb-4dd4-84d5-51910653bc1e req-d4f33d64-e02b-431d-81e2-5df962e7cbcc service nova] Releasing lock "refresh_cache-1b63ddc7-5f33-4d54-bac5-14c61df9fd49" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:16:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-fba20965-075a-48de-a959-0eda871134fd req-37d636e6-cb70-4145-917d-bf2760bf7883 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received event network-vif-plugged-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:16:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fba20965-075a-48de-a959-0eda871134fd req-37d636e6-cb70-4145-917d-bf2760bf7883 service nova] Acquiring lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fba20965-075a-48de-a959-0eda871134fd req-37d636e6-cb70-4145-917d-bf2760bf7883 service nova] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-fba20965-075a-48de-a959-0eda871134fd req-37d636e6-cb70-4145-917d-bf2760bf7883 service nova] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-fba20965-075a-48de-a959-0eda871134fd req-37d636e6-cb70-4145-917d-bf2760bf7883 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] No waiting events found dispatching network-vif-plugged-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:16:23 user nova-compute[73476]: WARNING nova.compute.manager [req-fba20965-075a-48de-a959-0eda871134fd req-37d636e6-cb70-4145-917d-bf2760bf7883 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received unexpected event network-vif-plugged-77943e99-2a3d-4f61-ab54-96fa33409c53 for instance with vm_state building and task_state spawning.
Aug 26 21:16:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:23 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084585.0570571, 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:16:25 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] VM Resumed (Lifecycle Event)
Aug 26 21:16:25 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Instance spawned successfully.
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-6286778b-e4b1-4b33-9f67-0c1c2dee9d4b req-ea1f01a6-2975-4e52-849d-d12cac1622b9 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received event network-vif-plugged-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6286778b-e4b1-4b33-9f67-0c1c2dee9d4b req-ea1f01a6-2975-4e52-849d-d12cac1622b9 service nova] Acquiring lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6286778b-e4b1-4b33-9f67-0c1c2dee9d4b req-ea1f01a6-2975-4e52-849d-d12cac1622b9 service nova] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-6286778b-e4b1-4b33-9f67-0c1c2dee9d4b req-ea1f01a6-2975-4e52-849d-d12cac1622b9 service nova] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.compute.manager [req-6286778b-e4b1-4b33-9f67-0c1c2dee9d4b req-ea1f01a6-2975-4e52-849d-d12cac1622b9 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] No waiting events found dispatching network-vif-plugged-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:16:25 user nova-compute[73476]: WARNING nova.compute.manager [req-6286778b-e4b1-4b33-9f67-0c1c2dee9d4b req-ea1f01a6-2975-4e52-849d-d12cac1622b9 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received unexpected event network-vif-plugged-77943e99-2a3d-4f61-ab54-96fa33409c53 for instance with vm_state building and task_state spawning.
Aug 26 21:16:25 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084585.0574636, 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:16:25 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] VM Started (Lifecycle Event)
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:16:25 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:16:25 user nova-compute[73476]: INFO nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 26 21:16:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:16:25 user nova-compute[73476]: INFO nova.compute.manager [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Took 6.53 seconds to build instance.
Aug 26 21:16:25 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-7eeec14b-a9d4-4b86-8e49-40adaeb0f1ae tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.624s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:16:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:30 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:52 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:52 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:52 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:52 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:16:55 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:16:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:59 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:16:59 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:16:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:16:59 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:16:59 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updating instance_info_cache with network_info: [{"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:17:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:17:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:17:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:17:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:17:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:17:02 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:17:02 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=25.088848114013672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "95313732-78dd-4689-b752-ae095d803408" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "95313732-78dd-4689-b752-ae095d803408-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:02 user nova-compute[73476]: INFO nova.compute.manager [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Terminating instance
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 95313732-78dd-4689-b752-ae095d803408 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 516bc7a5-b90d-4a09-ab6b-1128a88a3afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-9137e5c8-a073-4276-af77-9ad00fb13ee6 req-7dc0e2bf-2d78-468c-859b-fe41d6021703 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received event network-vif-unplugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9137e5c8-a073-4276-af77-9ad00fb13ee6 req-7dc0e2bf-2d78-468c-859b-fe41d6021703 service nova] Acquiring lock "95313732-78dd-4689-b752-ae095d803408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9137e5c8-a073-4276-af77-9ad00fb13ee6 req-7dc0e2bf-2d78-468c-859b-fe41d6021703 service nova] Lock "95313732-78dd-4689-b752-ae095d803408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9137e5c8-a073-4276-af77-9ad00fb13ee6 req-7dc0e2bf-2d78-468c-859b-fe41d6021703 service nova] Lock "95313732-78dd-4689-b752-ae095d803408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-9137e5c8-a073-4276-af77-9ad00fb13ee6 req-7dc0e2bf-2d78-468c-859b-fe41d6021703 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] No waiting events found dispatching network-vif-unplugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.manager [req-9137e5c8-a073-4276-af77-9ad00fb13ee6 req-7dc0e2bf-2d78-468c-859b-fe41d6021703 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received event network-vif-unplugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:02 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 95313732-78dd-4689-b752-ae095d803408] Instance destroyed successfully.
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.objects.instance [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lazy-loading 'resources' on Instance uuid 95313732-78dd-4689-b752-ae095d803408 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1175667773',display_name='tempest-TestServerVolumeAttachmentScenario-server-1175667773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1175667773',id=49,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO08J3P2O3FGqkNBMPpGLALqH+SsKGiqn1Zi+PgVwE493qzXxIuKJc7scT+kd8GWTRTnMeSGsWF98jW042FaS2FO7ZH/NOAier2AdpYxm3P5rTzpssQ7SM8jxPoqzD4vbg==',key_name='tempest-keypair-798354452',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:13:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5839ce6ffbec4fbeacaca0e424362ce4',ramdisk_id='',reservation_id='r-y4sja7p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2040081678',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2040081678-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbddcd2549d496fbe3c3ea2d93779bc',uuid=95313732-78dd-4689-b752-ae095d803408,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Converting VIF {"id": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "address": "fa:16:3e:7f:97:3a", "network": {"id": "af4d9e56-9830-4e8b-9c83-4aa050808aa9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-538786207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5839ce6ffbec4fbeacaca0e424362ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b56baf2-ef", "ovs_interfaceid": "3b56baf2-efe1-4b87-93f1-a6619ac34787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:97:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b56baf2-efe1-4b87-93f1-a6619ac34787,network=Network(af4d9e56-9830-4e8b-9c83-4aa050808aa9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b56baf2-ef') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG os_vif [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:97:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b56baf2-efe1-4b87-93f1-a6619ac34787,network=Network(af4d9e56-9830-4e8b-9c83-4aa050808aa9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b56baf2-ef') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b56baf2-ef, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:17:02 user nova-compute[73476]: INFO os_vif [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:97:3a,bridge_name='br-int',has_traffic_filtering=True,id=3b56baf2-efe1-4b87-93f1-a6619ac34787,network=Network(af4d9e56-9830-4e8b-9c83-4aa050808aa9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b56baf2-ef')
Aug 26 21:17:02 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Deleting instance files /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408_del
Aug 26 21:17:02 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Deletion of /opt/stack/data/nova/instances/95313732-78dd-4689-b752-ae095d803408_del complete
Aug 26 21:17:02 user nova-compute[73476]: INFO nova.compute.manager [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] [instance: 95313732-78dd-4689-b752-ae095d803408] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 21:17:02 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 95313732-78dd-4689-b752-ae095d803408] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:17:02 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 95313732-78dd-4689-b752-ae095d803408] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 95313732-78dd-4689-b752-ae095d803408] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:17:04 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 95313732-78dd-4689-b752-ae095d803408] Took 1.04 seconds to deallocate network for instance.
Aug 26 21:17:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-e6068b4f-3228-4f3f-9230-d6b45877093e req-13995eaa-36a5-4cc1-a593-8a23a1711eef service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received event network-vif-deleted-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:04 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Deleted allocations for instance 95313732-78dd-4689-b752-ae095d803408
Aug 26 21:17:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-e1a6a29c-64d9-4611-807e-cd4db217444d req-912e073e-5fb6-4d41-8949-70b60cb733f3 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received event network-vif-plugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e1a6a29c-64d9-4611-807e-cd4db217444d req-912e073e-5fb6-4d41-8949-70b60cb733f3 service nova] Acquiring lock "95313732-78dd-4689-b752-ae095d803408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e1a6a29c-64d9-4611-807e-cd4db217444d req-912e073e-5fb6-4d41-8949-70b60cb733f3 service nova] Lock "95313732-78dd-4689-b752-ae095d803408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-e1a6a29c-64d9-4611-807e-cd4db217444d req-912e073e-5fb6-4d41-8949-70b60cb733f3 service nova] Lock "95313732-78dd-4689-b752-ae095d803408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:04 user nova-compute[73476]: DEBUG nova.compute.manager [req-e1a6a29c-64d9-4611-807e-cd4db217444d req-912e073e-5fb6-4d41-8949-70b60cb733f3 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] No waiting events found dispatching network-vif-plugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:17:04 user nova-compute[73476]: WARNING nova.compute.manager [req-e1a6a29c-64d9-4611-807e-cd4db217444d req-912e073e-5fb6-4d41-8949-70b60cb733f3 service nova] [instance: 95313732-78dd-4689-b752-ae095d803408] Received unexpected event network-vif-plugged-3b56baf2-efe1-4b87-93f1-a6619ac34787 for instance with vm_state deleted and task_state None.
Aug 26 21:17:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-be167aa4-9795-4150-8273-7b9b38ee6bc7 tempest-TestServerVolumeAttachmentScenario-2040081678 tempest-TestServerVolumeAttachmentScenario-2040081678-project-member] Lock "95313732-78dd-4689-b752-ae095d803408" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.414s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:11 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:11 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:17 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084622.878646, 95313732-78dd-4689-b752-ae095d803408 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:17:17 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 95313732-78dd-4689-b752-ae095d803408] VM Stopped (Lifecycle Event)
Aug 26 21:17:17 user nova-compute[73476]: DEBUG nova.compute.manager [None req-a6ebaac9-425b-4461-a94d-2fa2fe046ca1 None None] [instance: 95313732-78dd-4689-b752-ae095d803408] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:17:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:17:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:17:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:17:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:17:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Verify base images {{(pid=73476) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Image id 810a80fc-a1eb-411e-8c1f-b24c6f7ca436 yields fingerprint a15cca87b4abddb8c4031123e04e0d8dcae41b5b {{(pid=73476) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] image 810a80fc-a1eb-411e-8c1f-b24c6f7ca436 at (/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b): checking
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] image 810a80fc-a1eb-411e-8c1f-b24c6f7ca436 at (/opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b): image is in use {{(pid=73476) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73476) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] 516bc7a5-b90d-4a09-ab6b-1128a88a3afe is a valid instance name {{(pid=73476) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 is a valid instance name {{(pid=73476) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 has a disk file {{(pid=73476) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 is backed by a15cca87b4abddb8c4031123e04e0d8dcae41b5b {{(pid=73476) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 21:17:19 user nova-compute[73476]: WARNING nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75
Aug 26 21:17:19 user nova-compute[73476]: WARNING nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c
Aug 26 21:17:19 user nova-compute[73476]: WARNING nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7
Aug 26 21:17:19 user nova-compute[73476]: WARNING nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771
Aug 26 21:17:19 user nova-compute[73476]: WARNING nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e
Aug 26 21:17:19 user nova-compute[73476]: WARNING nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a
Aug 26 21:17:19 user nova-compute[73476]: WARNING nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008
Aug 26 21:17:19 user nova-compute[73476]: WARNING nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1
Aug 26 21:17:19 user nova-compute[73476]: WARNING nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Active base files: /opt/stack/data/nova/instances/_base/a15cca87b4abddb8c4031123e04e0d8dcae41b5b
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Removable base files: /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75 /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7 /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771 /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008 /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1 /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bdf546daba4c2281315a8099ed20d5cba629ae75
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/280884a7f3feac6c75235b44169bb88a7576f46c
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/43890b37b382a9176bcfb9ef243693abc96965c7
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8aee39c8759c024ac2bb14219dd048759fed1771
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/26615134102b2c41ba7f02cfb02ba31ed60a508e
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/25d3a86643d84fab17f9bc2bab41e0f9fea55f0a
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f90740eeba57167cd5a842ff28de3e470ec81008
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6ea951000b55bf1b5e664f79d66642a9ced55cc1
Aug 26 21:17:19 user nova-compute[73476]: INFO nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/50e2a4348cda4e02b968b021d77929bac36bf9ec
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Verification complete {{(pid=73476) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Verify swap images {{(pid=73476) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 21:17:19 user nova-compute[73476]: DEBUG nova.virt.libvirt.imagecache [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Verify ephemeral images {{(pid=73476) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 21:17:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:17:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c107338-9796-48be-814b-b11fa203eb97 req-ad0f23c5-c14a-48f3-b8a4-030bb4aacd53 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received event network-changed-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG nova.compute.manager [req-3c107338-9796-48be-814b-b11fa203eb97 req-ad0f23c5-c14a-48f3-b8a4-030bb4aacd53 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Refreshing instance network info cache due to event network-changed-dd8613d1-ea36-4a21-be5e-298277e66668. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c107338-9796-48be-814b-b11fa203eb97 req-ad0f23c5-c14a-48f3-b8a4-030bb4aacd53 service nova] Acquiring lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c107338-9796-48be-814b-b11fa203eb97 req-ad0f23c5-c14a-48f3-b8a4-030bb4aacd53 service nova] Acquired lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG nova.network.neutron [req-3c107338-9796-48be-814b-b11fa203eb97 req-ad0f23c5-c14a-48f3-b8a4-030bb4aacd53 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Refreshing network info cache for port dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:17:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:17:33 user nova-compute[73476]: DEBUG nova.network.neutron [req-3c107338-9796-48be-814b-b11fa203eb97 req-ad0f23c5-c14a-48f3-b8a4-030bb4aacd53 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updated VIF entry in instance network info cache for port dd8613d1-ea36-4a21-be5e-298277e66668. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:17:33 user nova-compute[73476]: DEBUG nova.network.neutron [req-3c107338-9796-48be-814b-b11fa203eb97 req-ad0f23c5-c14a-48f3-b8a4-030bb4aacd53 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updating instance_info_cache with network_info: [{"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:17:33 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-3c107338-9796-48be-814b-b11fa203eb97 req-ad0f23c5-c14a-48f3-b8a4-030bb4aacd53 service nova] Releasing lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:17:35 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:40 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "3d08336b-a814-49aa-82eb-809916552a32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "3d08336b-a814-49aa-82eb-809916552a32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Starting instance... {{(pid=73476) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73476) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:17:48 user nova-compute[73476]: INFO nova.compute.claims [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Claim successful on node user
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Start building networks asynchronously for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Allocating IP information in the background. {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.network.neutron [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] allocate_for_instance() {{(pid=73476) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:17:48 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Start building block device mappings for instance. {{(pid=73476) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:17:48 user nova-compute[73476]: INFO nova.virt.block_device [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Booting with volume 96772596-db95-40cc-87ff-207c52b7c1b8 at /dev/vda
Aug 26 21:17:48 user nova-compute[73476]: DEBUG os_brick.utils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.policy [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bb1fc1180d34eb0ae98c52187aae87e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1962b32d78d4f6da29bb0fdaa001363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73476) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9bacbc-e9f7-4696-8716-7502bb25ecad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:82dfab6ec2d8\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e185706-132a-4c6f-b5ab-9d99e6ec9146]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a79376-a37e-4838-b35e-028bf5bee24c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a242c3-99d9-426a-a0d5-337427ba5e73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Running cmd (subprocess): nvme version {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] 'nvme version' failed. Not Retrying. {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.nvmeof [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] nvme not present on system {{(pid=73476) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:17:48 user nova-compute[73476]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:17:48 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbb4116-a6ee-41a0-8745-8d6782ce1cee]: (4, '') {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73476) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.lightos [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] LIGHTOS: no hostnqn found. {{(pid=73476) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG os_brick.utils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:82dfab6ec2d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:17:48 user nova-compute[73476]: DEBUG nova.virt.block_device [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updating existing volume attachment record: ddc5fd05-0610-4c51-a65f-704392043abf {{(pid=73476) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:17:49 user nova-compute[73476]: DEBUG nova.network.neutron [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Successfully created port: 7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Successfully updated port: 7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquired lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Building network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-392ebfe1-cb74-482f-b584-4658cb983b55 req-b66693a2-2abb-40c0-9065-b343e1c7fac6 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received event network-changed-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG nova.compute.manager [req-392ebfe1-cb74-482f-b584-4658cb983b55 req-b66693a2-2abb-40c0-9065-b343e1c7fac6 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Refreshing instance network info cache due to event network-changed-7db63f94-9ab4-4d7d-832f-19ca7091bd1c. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-392ebfe1-cb74-482f-b584-4658cb983b55 req-b66693a2-2abb-40c0-9065-b343e1c7fac6 service nova] Acquiring lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Instance cache missing network info. {{(pid=73476) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73476) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG nova.network.neutron [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updating instance_info_cache with network_info: [{"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Releasing lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Instance network_info: |[{"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73476) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-392ebfe1-cb74-482f-b584-4658cb983b55 req-b66693a2-2abb-40c0-9065-b343e1c7fac6 service nova] Acquired lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG nova.network.neutron [req-392ebfe1-cb74-482f-b584-4658cb983b55 req-b66693a2-2abb-40c0-9065-b343e1c7fac6 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Refreshing network info cache for port 7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:17:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-392ebfe1-cb74-482f-b584-4658cb983b55 req-b66693a2-2abb-40c0-9065-b343e1c7fac6 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updated VIF entry in instance network info cache for port 7db63f94-9ab4-4d7d-832f-19ca7091bd1c. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:17:51 user nova-compute[73476]: DEBUG nova.network.neutron [req-392ebfe1-cb74-482f-b584-4658cb983b55 req-b66693a2-2abb-40c0-9065-b343e1c7fac6 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updating instance_info_cache with network_info: [{"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:17:51 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-392ebfe1-cb74-482f-b584-4658cb983b55 req-b66693a2-2abb-40c0-9065-b343e1c7fac6 service nova] Releasing lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:17:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:17:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:54 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:54 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:17:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:17:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Start spawning the instance on the hypervisor. {{(pid=73476) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Creating instance directory {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:18:00 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Creating image(s)
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Did not create local disks {{(pid=73476) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Ensure instance console log exists: /opt/stack/data/nova/instances/3d08336b-a814-49aa-82eb-809916552a32/console.log {{(pid=73476) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Start _get_guest_xml network_info=[{"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'ddc5fd05-0610-4c51-a65f-704392043abf', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFziOIkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d08336b-a814-49aa-82eb-809916552a32', 'attached_at': '', 'detached_at': '', 'volume_id': '96772596-db95-40cc-87ff-207c52b7c1b8', 'serial': '96772596-db95-40cc-87ff-207c52b7c1b8'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:18:00 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:18:00 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller missing on host. {{(pid=73476) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.host [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU controller found on host. {{(pid=73476) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73476) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T20:37:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image limits 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flavor pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Image pref 0:0:0 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Got 1 possible topologies {{(pid=73476) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.hardware [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73476) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Calling os-brick to attach iSCSI Volume {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFziOIkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:18:00 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:18:00 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:18:00 user nova-compute[73476]: INFO os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cef20b9-f1ba-41f6-968b-32e3b7a1be48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:18:00 user nova-compute[73476]:  {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d3369-106e-402e-9a90-fd61a741f82d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8] added\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8] added
Aug 26 21:18:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[475a8145-d6e4-4659-92a0-df8cd0925297]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4acc525-e2cc-4379-b984-626f75c528ea]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFziOIkr {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFziOIkr" returned: 0 in 0.025s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae1f363-8528-4978-95c1-98ddef469b21]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GFziOIkr'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[5979a2d1-e2ad-41ff-90b0-fa4212c9d638]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b69fd9-8321-4939-b88f-f7956c220d77]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:18:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:18:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --login {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[332375b4-4bde-4114-b434-4652065213ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8, portal: 172.16.0.220,3260]
Aug 26 21:18:00 user nova-compute[73476]: Login to [iface: default, target: iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8, portal: 172.16.0.220,3260] successful.
Aug 26 21:18:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba7b60d-131e-46a0-9b05-55244ca89177]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29e8adc-01fc-4337-9636-a441866394cf]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:18:00 user nova-compute[73476]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 (non-flash)
Aug 26 21:18:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:18:00 user nova-compute[73476]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 (non-flash)
Aug 26 21:18:00 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to 172.16.0.220:3260 {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73476) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73476) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e9b934-bdd0-44be-a8b4-670d7f88f9a5]: (4, ('- - 0', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:18:00 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73476) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73476) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFziOIkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73476) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.548s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== connect_volume: return (1550ms) {'type': 'block', 'scsi_wwn': '23531626565656238', 'path': '/dev/sdb'} {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531626565656238', 'path': '/dev/sdb'} {{(pid=73476) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:18:01 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:18:01 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8603MB free_disk=25.1151123046875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2050537881',display_name='tempest-TestVolumeBootPattern-server-2050537881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2050537881',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp0nGdKWqt25Vovv//zECtWPkdETKJV26I8dVi13Vaw97KRWRRvyx63r4FOvfGKO/4n655MVUFeORvL2Dj2aVlVmOVr7QUBY9FdJPdc/33XGtLV0TAuage04axfNiAeSg==',key_name='tempest-TestVolumeBootPattern-1669868756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-8cy0hdex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:17:49Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=3d08336b-a814-49aa-82eb-809916552a32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73476) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ec:ab,bridge_name='br-int',has_traffic_filtering=True,id=7db63f94-9ab4-4d7d-832f-19ca7091bd1c,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db63f94-9a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.objects.instance [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d08336b-a814-49aa-82eb-809916552a32 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:18:01 user nova-compute[73476]:   <uuid>3d08336b-a814-49aa-82eb-809916552a32</uuid>
Aug 26 21:18:01 user nova-compute[73476]:   <name>instance-00000034</name>
Aug 26 21:18:01 user nova-compute[73476]:   <memory>524288</memory>
Aug 26 21:18:01 user nova-compute[73476]:   <vcpu>1</vcpu>
Aug 26 21:18:01 user nova-compute[73476]:   <metadata>
Aug 26 21:18:01 user nova-compute[73476]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:18:01 user nova-compute[73476]:       <nova:package version="0.0.0"/>
Aug 26 21:18:01 user nova-compute[73476]:       <nova:name>tempest-TestVolumeBootPattern-server-2050537881</nova:name>
Aug 26 21:18:01 user nova-compute[73476]:       <nova:creationTime>2023-08-26 21:18:00</nova:creationTime>
Aug 26 21:18:01 user nova-compute[73476]:       <nova:flavor name="m1.tiny">
Aug 26 21:18:01 user nova-compute[73476]:         <nova:memory>512</nova:memory>
Aug 26 21:18:01 user nova-compute[73476]:         <nova:disk>1</nova:disk>
Aug 26 21:18:01 user nova-compute[73476]:         <nova:swap>0</nova:swap>
Aug 26 21:18:01 user nova-compute[73476]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:18:01 user nova-compute[73476]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:18:01 user nova-compute[73476]:       </nova:flavor>
Aug 26 21:18:01 user nova-compute[73476]:       <nova:owner>
Aug 26 21:18:01 user nova-compute[73476]:         <nova:user uuid="5bb1fc1180d34eb0ae98c52187aae87e">tempest-TestVolumeBootPattern-443030295-project-member</nova:user>
Aug 26 21:18:01 user nova-compute[73476]:         <nova:project uuid="a1962b32d78d4f6da29bb0fdaa001363">tempest-TestVolumeBootPattern-443030295</nova:project>
Aug 26 21:18:01 user nova-compute[73476]:       </nova:owner>
Aug 26 21:18:01 user nova-compute[73476]:       <nova:ports>
Aug 26 21:18:01 user nova-compute[73476]:         <nova:port uuid="7db63f94-9ab4-4d7d-832f-19ca7091bd1c">
Aug 26 21:18:01 user nova-compute[73476]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 21:18:01 user nova-compute[73476]:         </nova:port>
Aug 26 21:18:01 user nova-compute[73476]:       </nova:ports>
Aug 26 21:18:01 user nova-compute[73476]:     </nova:instance>
Aug 26 21:18:01 user nova-compute[73476]:   </metadata>
Aug 26 21:18:01 user nova-compute[73476]:   <sysinfo type="smbios">
Aug 26 21:18:01 user nova-compute[73476]:     <system>
Aug 26 21:18:01 user nova-compute[73476]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:18:01 user nova-compute[73476]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:18:01 user nova-compute[73476]:       <entry name="version">0.0.0</entry>
Aug 26 21:18:01 user nova-compute[73476]:       <entry name="serial">3d08336b-a814-49aa-82eb-809916552a32</entry>
Aug 26 21:18:01 user nova-compute[73476]:       <entry name="uuid">3d08336b-a814-49aa-82eb-809916552a32</entry>
Aug 26 21:18:01 user nova-compute[73476]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:18:01 user nova-compute[73476]:     </system>
Aug 26 21:18:01 user nova-compute[73476]:   </sysinfo>
Aug 26 21:18:01 user nova-compute[73476]:   <os>
Aug 26 21:18:01 user nova-compute[73476]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:18:01 user nova-compute[73476]:     <boot dev="hd"/>
Aug 26 21:18:01 user nova-compute[73476]:     <smbios mode="sysinfo"/>
Aug 26 21:18:01 user nova-compute[73476]:   </os>
Aug 26 21:18:01 user nova-compute[73476]:   <features>
Aug 26 21:18:01 user nova-compute[73476]:     <acpi/>
Aug 26 21:18:01 user nova-compute[73476]:     <apic/>
Aug 26 21:18:01 user nova-compute[73476]:     <vmcoreinfo/>
Aug 26 21:18:01 user nova-compute[73476]:   </features>
Aug 26 21:18:01 user nova-compute[73476]:   <clock offset="utc">
Aug 26 21:18:01 user nova-compute[73476]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:18:01 user nova-compute[73476]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:18:01 user nova-compute[73476]:     <timer name="hpet" present="no"/>
Aug 26 21:18:01 user nova-compute[73476]:   </clock>
Aug 26 21:18:01 user nova-compute[73476]:   <cpu mode="custom" match="exact">
Aug 26 21:18:01 user nova-compute[73476]:     <model>Nehalem</model>
Aug 26 21:18:01 user nova-compute[73476]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:18:01 user nova-compute[73476]:   </cpu>
Aug 26 21:18:01 user nova-compute[73476]:   <devices>
Aug 26 21:18:01 user nova-compute[73476]:     <disk type="block" device="disk">
Aug 26 21:18:01 user nova-compute[73476]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:18:01 user nova-compute[73476]:       <source dev="/dev/sdb"/>
Aug 26 21:18:01 user nova-compute[73476]:       <target dev="vda" bus="virtio"/>
Aug 26 21:18:01 user nova-compute[73476]:       <serial>96772596-db95-40cc-87ff-207c52b7c1b8</serial>
Aug 26 21:18:01 user nova-compute[73476]:     </disk>
Aug 26 21:18:01 user nova-compute[73476]:     <interface type="ethernet">
Aug 26 21:18:01 user nova-compute[73476]:       <mac address="fa:16:3e:a1:ec:ab"/>
Aug 26 21:18:01 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:18:01 user nova-compute[73476]:       <mtu size="1442"/>
Aug 26 21:18:01 user nova-compute[73476]:       <target dev="tap7db63f94-9a"/>
Aug 26 21:18:01 user nova-compute[73476]:     </interface>
Aug 26 21:18:01 user nova-compute[73476]:     <serial type="pty">
Aug 26 21:18:01 user nova-compute[73476]:       <log file="/opt/stack/data/nova/instances/3d08336b-a814-49aa-82eb-809916552a32/console.log" append="off"/>
Aug 26 21:18:01 user nova-compute[73476]:     </serial>
Aug 26 21:18:01 user nova-compute[73476]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:18:01 user nova-compute[73476]:     <video>
Aug 26 21:18:01 user nova-compute[73476]:       <model type="virtio"/>
Aug 26 21:18:01 user nova-compute[73476]:     </video>
Aug 26 21:18:01 user nova-compute[73476]:     <rng model="virtio">
Aug 26 21:18:01 user nova-compute[73476]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:18:01 user nova-compute[73476]:     </rng>
Aug 26 21:18:01 user nova-compute[73476]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:18:01 user nova-compute[73476]:     <memballoon model="virtio">
Aug 26 21:18:01 user nova-compute[73476]:       <stats period="10"/>
Aug 26 21:18:01 user nova-compute[73476]:     </memballoon>
Aug 26 21:18:01 user nova-compute[73476]:   </devices>
Aug 26 21:18:01 user nova-compute[73476]: </domain>
Aug 26 21:18:01 user nova-compute[73476]:  {{(pid=73476) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2050537881',display_name='tempest-TestVolumeBootPattern-server-2050537881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2050537881',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp0nGdKWqt25Vovv//zECtWPkdETKJV26I8dVi13Vaw97KRWRRvyx63r4FOvfGKO/4n655MVUFeORvL2Dj2aVlVmOVr7QUBY9FdJPdc/33XGtLV0TAuage04axfNiAeSg==',key_name='tempest-TestVolumeBootPattern-1669868756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-8cy0hdex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:17:49Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=3d08336b-a814-49aa-82eb-809916552a32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ec:ab,bridge_name='br-int',has_traffic_filtering=True,id=7db63f94-9ab4-4d7d-832f-19ca7091bd1c,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db63f94-9a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG os_vif [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ec:ab,bridge_name='br-int',has_traffic_filtering=True,id=7db63f94-9ab4-4d7d-832f-19ca7091bd1c,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db63f94-9a') {{(pid=73476) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7db63f94-9a, may_exist=True, interface_attrs={}) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7db63f94-9a, col_values=(('external_ids', {'iface-id': '7db63f94-9ab4-4d7d-832f-19ca7091bd1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:ec:ab', 'vm-uuid': '3d08336b-a814-49aa-82eb-809916552a32'}),), if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:01 user nova-compute[73476]: INFO os_vif [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ec:ab,bridge_name='br-int',has_traffic_filtering=True,id=7db63f94-9ab4-4d7d-832f-19ca7091bd1c,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db63f94-9a')
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No BDM found with device name vda, not building metadata. {{(pid=73476) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] No VIF found with MAC fa:16:3e:a1:ec:ab, not building metadata {{(pid=73476) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 516bc7a5-b90d-4a09-ab6b-1128a88a3afe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3d08336b-a814-49aa-82eb-809916552a32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing inventories for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating ProviderTree inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 21:18:01 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing aggregate associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, aggregates: None {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 21:18:02 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing trait associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 21:18:02 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:18:02 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:18:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:18:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Skipping network cache update for instance because it is Building. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-15ce169c-6c21-4669-afb8-d091b01055c7 req-b44401c2-fd34-45b4-a7fb-4e692c271069 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received event network-vif-plugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-15ce169c-6c21-4669-afb8-d091b01055c7 req-b44401c2-fd34-45b4-a7fb-4e692c271069 service nova] Acquiring lock "3d08336b-a814-49aa-82eb-809916552a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-15ce169c-6c21-4669-afb8-d091b01055c7 req-b44401c2-fd34-45b4-a7fb-4e692c271069 service nova] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-15ce169c-6c21-4669-afb8-d091b01055c7 req-b44401c2-fd34-45b4-a7fb-4e692c271069 service nova] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG nova.compute.manager [req-15ce169c-6c21-4669-afb8-d091b01055c7 req-b44401c2-fd34-45b4-a7fb-4e692c271069 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] No waiting events found dispatching network-vif-plugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:18:03 user nova-compute[73476]: WARNING nova.compute.manager [req-15ce169c-6c21-4669-afb8-d091b01055c7 req-b44401c2-fd34-45b4-a7fb-4e692c271069 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received unexpected event network-vif-plugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c for instance with vm_state building and task_state spawning.
Aug 26 21:18:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 516bc7a5-b90d-4a09-ab6b-1128a88a3afe {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:03 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:04 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updating instance_info_cache with network_info: [{"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:18:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:18:04 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:18:04 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-2946e202-aed1-4651-95cc-b15ab4eff0c7 req-11ed58d4-1206-465d-8afa-be827073df33 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received event network-vif-plugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2946e202-aed1-4651-95cc-b15ab4eff0c7 req-11ed58d4-1206-465d-8afa-be827073df33 service nova] Acquiring lock "3d08336b-a814-49aa-82eb-809916552a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2946e202-aed1-4651-95cc-b15ab4eff0c7 req-11ed58d4-1206-465d-8afa-be827073df33 service nova] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-2946e202-aed1-4651-95cc-b15ab4eff0c7 req-11ed58d4-1206-465d-8afa-be827073df33 service nova] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.compute.manager [req-2946e202-aed1-4651-95cc-b15ab4eff0c7 req-11ed58d4-1206-465d-8afa-be827073df33 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] No waiting events found dispatching network-vif-plugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:18:05 user nova-compute[73476]: WARNING nova.compute.manager [req-2946e202-aed1-4651-95cc-b15ab4eff0c7 req-11ed58d4-1206-465d-8afa-be827073df33 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received unexpected event network-vif-plugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c for instance with vm_state building and task_state spawning.
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084685.4787822, 3d08336b-a814-49aa-82eb-809916552a32 => Resumed> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:18:05 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] VM Resumed (Lifecycle Event)
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Instance event wait completed in 0 seconds for  {{(pid=73476) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Guest created on hypervisor {{(pid=73476) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:18:05 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Instance spawned successfully.
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Found default for hw_cdrom_bus of ide {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Found default for hw_disk_bus of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Found default for hw_input_bus of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Found default for hw_pointer_model of None {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Found default for hw_video_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Found default for hw_vif_model of virtio {{(pid=73476) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:18:05 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.virt.driver [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] Emitting event <LifecycleEvent: 1693084685.4802065, 3d08336b-a814-49aa-82eb-809916552a32 => Started> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:18:05 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] VM Started (Lifecycle Event)
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73476) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:18:05 user nova-compute[73476]: INFO nova.compute.manager [None req-82428ed5-e0a5-4356-8853-3cb1a024a661 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:18:05 user nova-compute[73476]: INFO nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 26 21:18:05 user nova-compute[73476]: DEBUG nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:18:05 user nova-compute[73476]: INFO nova.compute.manager [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Took 17.60 seconds to build instance.
Aug 26 21:18:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-449d950b-3ba5-490f-b708-47684f836167 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "3d08336b-a814-49aa-82eb-809916552a32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.702s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:05 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:07 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:09 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:10 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:11 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:13 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:14 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquiring lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquiring lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:20 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:20 user nova-compute[73476]: INFO nova.compute.manager [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Terminating instance
Aug 26 21:18:20 user nova-compute[73476]: DEBUG nova.compute.manager [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:18:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:20 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-9232000f-c74e-45cd-8343-39bf0eb9c6dd req-4273ebb0-287b-44b4-b4b6-5bb60ec2e9f3 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received event network-vif-unplugged-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9232000f-c74e-45cd-8343-39bf0eb9c6dd req-4273ebb0-287b-44b4-b4b6-5bb60ec2e9f3 service nova] Acquiring lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9232000f-c74e-45cd-8343-39bf0eb9c6dd req-4273ebb0-287b-44b4-b4b6-5bb60ec2e9f3 service nova] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-9232000f-c74e-45cd-8343-39bf0eb9c6dd req-4273ebb0-287b-44b4-b4b6-5bb60ec2e9f3 service nova] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-9232000f-c74e-45cd-8343-39bf0eb9c6dd req-4273ebb0-287b-44b4-b4b6-5bb60ec2e9f3 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] No waiting events found dispatching network-vif-unplugged-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG nova.compute.manager [req-9232000f-c74e-45cd-8343-39bf0eb9c6dd req-4273ebb0-287b-44b4-b4b6-5bb60ec2e9f3 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received event network-vif-unplugged-77943e99-2a3d-4f61-ab54-96fa33409c53 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Instance destroyed successfully.
Aug 26 21:18:21 user nova-compute[73476]: DEBUG nova.objects.instance [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lazy-loading 'resources' on Instance uuid 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-337955748',display_name='tempest-VolumesActionsTest-instance-337955748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-337955748',id=51,image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bf393885a64727844482ea968586a1',ramdisk_id='',reservation_id='r-p647is25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='810a80fc-a1eb-411e-8c1f-b24c6f7ca436',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1478997525',owner_user_name='tempest-VolumesActionsTest-1478997525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:16:25Z,user_data=None,user_id='b1a37c221387416aba4e3203d6c8e053',uuid=1b63ddc7-5f33-4d54-bac5-14c61df9fd49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Converting VIF {"id": "77943e99-2a3d-4f61-ab54-96fa33409c53", "address": "fa:16:3e:f8:47:38", "network": {"id": "fafbc887-687e-4470-8662-ff6089f6f3d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2120006679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bf393885a64727844482ea968586a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77943e99-2a", "ovs_interfaceid": "77943e99-2a3d-4f61-ab54-96fa33409c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:47:38,bridge_name='br-int',has_traffic_filtering=True,id=77943e99-2a3d-4f61-ab54-96fa33409c53,network=Network(fafbc887-687e-4470-8662-ff6089f6f3d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77943e99-2a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG os_vif [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:47:38,bridge_name='br-int',has_traffic_filtering=True,id=77943e99-2a3d-4f61-ab54-96fa33409c53,network=Network(fafbc887-687e-4470-8662-ff6089f6f3d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77943e99-2a') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77943e99-2a, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:18:21 user nova-compute[73476]: INFO os_vif [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:47:38,bridge_name='br-int',has_traffic_filtering=True,id=77943e99-2a3d-4f61-ab54-96fa33409c53,network=Network(fafbc887-687e-4470-8662-ff6089f6f3d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77943e99-2a')
Aug 26 21:18:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Deleting instance files /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49_del
Aug 26 21:18:21 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Deletion of /opt/stack/data/nova/instances/1b63ddc7-5f33-4d54-bac5-14c61df9fd49_del complete
Aug 26 21:18:21 user nova-compute[73476]: INFO nova.compute.manager [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 21:18:21 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:18:21 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:18:22 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:18:22 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Took 0.45 seconds to deallocate network for instance.
Aug 26 21:18:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:22 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:18:22 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:18:22 user nova-compute[73476]: DEBUG nova.compute.manager [req-bd13aac0-cd7d-4c3a-8072-a3e8572b7506 req-feabc89f-9c58-4f06-aff3-feccb605f04b service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received event network-vif-deleted-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:18:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:22 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Deleted allocations for instance 1b63ddc7-5f33-4d54-bac5-14c61df9fd49
Aug 26 21:18:22 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-f8b02ef6-b2a9-480a-a419-7fa5eb67dc7f tempest-VolumesActionsTest-1478997525 tempest-VolumesActionsTest-1478997525-project-member] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.814s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-72d7c3b8-bb15-4933-baef-a962cfc82949 req-b916425b-5a4d-4bc0-8148-807b9a34cbd3 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received event network-vif-plugged-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:18:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-72d7c3b8-bb15-4933-baef-a962cfc82949 req-b916425b-5a4d-4bc0-8148-807b9a34cbd3 service nova] Acquiring lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:18:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-72d7c3b8-bb15-4933-baef-a962cfc82949 req-b916425b-5a4d-4bc0-8148-807b9a34cbd3 service nova] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:18:23 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-72d7c3b8-bb15-4933-baef-a962cfc82949 req-b916425b-5a4d-4bc0-8148-807b9a34cbd3 service nova] Lock "1b63ddc7-5f33-4d54-bac5-14c61df9fd49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:18:23 user nova-compute[73476]: DEBUG nova.compute.manager [req-72d7c3b8-bb15-4933-baef-a962cfc82949 req-b916425b-5a4d-4bc0-8148-807b9a34cbd3 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] No waiting events found dispatching network-vif-plugged-77943e99-2a3d-4f61-ab54-96fa33409c53 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:18:23 user nova-compute[73476]: WARNING nova.compute.manager [req-72d7c3b8-bb15-4933-baef-a962cfc82949 req-b916425b-5a4d-4bc0-8148-807b9a34cbd3 service nova] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Received unexpected event network-vif-plugged-77943e99-2a3d-4f61-ab54-96fa33409c53 for instance with vm_state deleted and task_state None.
Aug 26 21:18:25 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 21:18:25 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] There are 0 instances to clean {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 21:18:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:36 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084701.6173728, 1b63ddc7-5f33-4d54-bac5-14c61df9fd49 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:18:36 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] VM Stopped (Lifecycle Event)
Aug 26 21:18:36 user nova-compute[73476]: DEBUG nova.compute.manager [None req-1221e580-7c56-4629-a78a-4dae2e0acf0b None None] [instance: 1b63ddc7-5f33-4d54-bac5-14c61df9fd49] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:18:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:18:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:18:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:18:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:18:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:18:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:51 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:53 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:54 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:56 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:18:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:18:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:18:59 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:19:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:19:00 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:19:00 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:19:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:19:00 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:19:01 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:19:01 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:19:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8686MB free_disk=25.14080810546875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 516bc7a5-b90d-4a09-ab6b-1128a88a3afe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 3d08336b-a814-49aa-82eb-809916552a32 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:19:01 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 516bc7a5-b90d-4a09-ab6b-1128a88a3afe {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Triggering sync for uuid 3d08336b-a814-49aa-82eb-809916552a32 {{(pid=73476) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "3d08336b-a814-49aa-82eb-809916552a32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "3d08336b-a814-49aa-82eb-809916552a32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:19:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "3d08336b-a814-49aa-82eb-809916552a32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:19:03 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:06 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:19:10 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:11 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:12 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:16 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:19:21 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:26 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:19:31 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:19:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:19:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:19:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:19:36 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:39 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-18177199-20cf-4132-8f58-1b1fbd0cc553 req-8729ad7e-87cc-4ae3-98a5-3556cb03a4b2 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received event network-changed-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:19:40 user nova-compute[73476]: DEBUG nova.compute.manager [req-18177199-20cf-4132-8f58-1b1fbd0cc553 req-8729ad7e-87cc-4ae3-98a5-3556cb03a4b2 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Refreshing instance network info cache due to event network-changed-7db63f94-9ab4-4d7d-832f-19ca7091bd1c. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:19:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-18177199-20cf-4132-8f58-1b1fbd0cc553 req-8729ad7e-87cc-4ae3-98a5-3556cb03a4b2 service nova] Acquiring lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:19:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-18177199-20cf-4132-8f58-1b1fbd0cc553 req-8729ad7e-87cc-4ae3-98a5-3556cb03a4b2 service nova] Acquired lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:19:40 user nova-compute[73476]: DEBUG nova.network.neutron [req-18177199-20cf-4132-8f58-1b1fbd0cc553 req-8729ad7e-87cc-4ae3-98a5-3556cb03a4b2 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Refreshing network info cache for port 7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:19:40 user nova-compute[73476]: DEBUG nova.network.neutron [req-18177199-20cf-4132-8f58-1b1fbd0cc553 req-8729ad7e-87cc-4ae3-98a5-3556cb03a4b2 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updated VIF entry in instance network info cache for port 7db63f94-9ab4-4d7d-832f-19ca7091bd1c. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:19:40 user nova-compute[73476]: DEBUG nova.network.neutron [req-18177199-20cf-4132-8f58-1b1fbd0cc553 req-8729ad7e-87cc-4ae3-98a5-3556cb03a4b2 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updating instance_info_cache with network_info: [{"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:19:40 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-18177199-20cf-4132-8f58-1b1fbd0cc553 req-8729ad7e-87cc-4ae3-98a5-3556cb03a4b2 service nova] Releasing lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "3d08336b-a814-49aa-82eb-809916552a32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "3d08336b-a814-49aa-82eb-809916552a32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "3d08336b-a814-49aa-82eb-809916552a32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:19:41 user nova-compute[73476]: INFO nova.compute.manager [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Terminating instance
Aug 26 21:19:41 user nova-compute[73476]: DEBUG nova.compute.manager [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:41 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:42 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Instance destroyed successfully.
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.objects.instance [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'resources' on Instance uuid 3d08336b-a814-49aa-82eb-809916552a32 {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2050537881',display_name='tempest-TestVolumeBootPattern-server-2050537881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2050537881',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp0nGdKWqt25Vovv//zECtWPkdETKJV26I8dVi13Vaw97KRWRRvyx63r4FOvfGKO/4n655MVUFeORvL2Dj2aVlVmOVr7QUBY9FdJPdc/33XGtLV0TAuage04axfNiAeSg==',key_name='tempest-TestVolumeBootPattern-1669868756',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-8cy0hdex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:18:06Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=3d08336b-a814-49aa-82eb-809916552a32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ec:ab,bridge_name='br-int',has_traffic_filtering=True,id=7db63f94-9ab4-4d7d-832f-19ca7091bd1c,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db63f94-9a') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_vif [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ec:ab,bridge_name='br-int',has_traffic_filtering=True,id=7db63f94-9ab4-4d7d-832f-19ca7091bd1c,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db63f94-9a') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7db63f94-9a, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:19:42 user nova-compute[73476]: INFO os_vif [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ec:ab,bridge_name='br-int',has_traffic_filtering=True,id=7db63f94-9ab4-4d7d-832f-19ca7091bd1c,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db63f94-9a')
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFziOIkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:19:42 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c06509b-33d9-4f7e-b7b9-1f2313352edb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b246d37-bcf4-48e5-82b1-049f5d8b8fd4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:19:42 user nova-compute[73476]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 (non-flash)
Aug 26 21:19:42 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:19:42 user nova-compute[73476]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 (non-flash)
Aug 26 21:19:42 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f258ceb1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8'): ({'sdb'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Removing single pathed devices sdb {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c607ad86-4410-4825-a7b6-b7d1f087a928]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[332283a4-d5b7-4249-b61c-b2b9917a92da]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flushing IO for device /dev/sdb {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4189d723-88f8-4b87-ba3b-8a1860eb9e30]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee86795-99a2-4b81-9833-fb8678a199f6]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] SCSI volumes sdb have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23531626565656238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a7363c6a', '/dev/disk/by-id/scsi-1SCST_BIOa7363c6a-51beeeb83b5ae7f0') {{(pid=84820) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c860ff-7e93-4386-b384-8053c97655fd]: (4, None) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[212b00fc-7567-4629-8bc0-a36dd5ba33bd]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[af687ba7-cb61-43ac-be63-7154c035ecd5]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8, portal: 172.16.0.220,3260]
Aug 26 21:19:42 user nova-compute[73476]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8, portal: 172.16.0.220,3260] successful.
Aug 26 21:19:42 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.compute.manager [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received event network-changed-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.compute.manager [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Refreshing instance network info cache due to event network-changed-7db63f94-9ab4-4d7d-832f-19ca7091bd1c. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] Acquiring lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] Acquired lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.network.neutron [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Refreshing network info cache for port 7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96772596-db95-40cc-87ff-207c52b7c1b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[848504fc-2206-4511-b39e-a217a45692f5]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== disconnect_volume: return (287ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:19:42 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Deleting instance files /opt/stack/data/nova/instances/3d08336b-a814-49aa-82eb-809916552a32_del
Aug 26 21:19:42 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Deletion of /opt/stack/data/nova/instances/3d08336b-a814-49aa-82eb-809916552a32_del complete
Aug 26 21:19:42 user nova-compute[73476]: INFO nova.compute.manager [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 26 21:19:42 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:19:42 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 3d08336b-a814-49aa-82eb-809916552a32] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updated VIF entry in instance network info cache for port 7db63f94-9ab4-4d7d-832f-19ca7091bd1c. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updating instance_info_cache with network_info: [{"id": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "address": "fa:16:3e:a1:ec:ab", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db63f94-9a", "ovs_interfaceid": "7db63f94-9ab4-4d7d-832f-19ca7091bd1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] Releasing lock "refresh_cache-3d08336b-a814-49aa-82eb-809916552a32" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received event network-vif-unplugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] Acquiring lock "3d08336b-a814-49aa-82eb-809916552a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] No waiting events found dispatching network-vif-unplugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received event network-vif-unplugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received event network-vif-plugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] Acquiring lock "3d08336b-a814-49aa-82eb-809916552a32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] Lock "3d08336b-a814-49aa-82eb-809916552a32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] No waiting events found dispatching network-vif-plugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:19:43 user nova-compute[73476]: WARNING nova.compute.manager [req-b02844bc-b759-4b5b-9b9b-9acad2c93474 req-4fe67614-0983-4fff-8646-45a4f7d10882 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received unexpected event network-vif-plugged-7db63f94-9ab4-4d7d-832f-19ca7091bd1c for instance with vm_state active and task_state deleting.
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:19:43 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Took 1.47 seconds to deallocate network for instance.
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-3a9779bd-ca85-4625-8007-6e1bd23a1ef7 req-4793d2de-e874-4402-9800-f641f579b530 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Received event network-vif-deleted-7db63f94-9ab4-4d7d-832f-19ca7091bd1c {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:19:43 user nova-compute[73476]: INFO nova.compute.manager [req-3a9779bd-ca85-4625-8007-6e1bd23a1ef7 req-4793d2de-e874-4402-9800-f641f579b530 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Neutron deleted interface 7db63f94-9ab4-4d7d-832f-19ca7091bd1c; detaching it from the instance and deleting it from the info cache
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.network.neutron [req-3a9779bd-ca85-4625-8007-6e1bd23a1ef7 req-4793d2de-e874-4402-9800-f641f579b530 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:19:43 user nova-compute[73476]: DEBUG nova.compute.manager [req-3a9779bd-ca85-4625-8007-6e1bd23a1ef7 req-4793d2de-e874-4402-9800-f641f579b530 service nova] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Detach interface failed, port_id=7db63f94-9ab4-4d7d-832f-19ca7091bd1c, reason: Instance 3d08336b-a814-49aa-82eb-809916552a32 could not be found. {{(pid=73476) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 21:19:44 user nova-compute[73476]: INFO nova.compute.manager [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Took 0.98 seconds to detach 1 volumes for instance.
Aug 26 21:19:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:19:44 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:19:45 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:19:45 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:19:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:19:45 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Deleted allocations for instance 3d08336b-a814-49aa-82eb-809916552a32
Aug 26 21:19:45 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-089b3152-1f1c-448f-8bac-65d216a3b398 tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "3d08336b-a814-49aa-82eb-809916552a32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.952s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:19:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:19:54 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:19:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:19:57 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084782.0465055, 3d08336b-a814-49aa-82eb-809916552a32 => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:19:57 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 3d08336b-a814-49aa-82eb-809916552a32] VM Stopped (Lifecycle Event)
Aug 26 21:19:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-10fa0659-4496-4428-97c6-4e85e5de6519 None None] [instance: 3d08336b-a814-49aa-82eb-809916552a32] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:19:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:20:01 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:20:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:20:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:20:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:20:01 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquired lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:20:01 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Forcefully refreshing network info cache for instance {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:20:01 user nova-compute[73476]: DEBUG nova.objects.instance [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lazy-loading 'info_cache' on Instance uuid 516bc7a5-b90d-4a09-ab6b-1128a88a3afe {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG nova.network.neutron [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updating instance_info_cache with network_info: [{"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Releasing lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updated the network info_cache for instance {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:20:02 user nova-compute[73476]: DEBUG nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73476) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:20:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:20:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:20:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=25.13109588623047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:20:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:20:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:20:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Instance 516bc7a5-b90d-4a09-ab6b-1128a88a3afe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73476) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:20:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:20:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:20:03 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:20:03 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:20:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:20:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:20:05 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:20:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:20:08 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:20:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:20:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:12 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:20:12 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:20:15 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:20:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:20:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-1df13cb8-c66d-418f-a9d2-b54b8ff5d559 req-acda3ac7-61b2-42ad-9504-b56a8482dd85 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received event network-changed-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-1df13cb8-c66d-418f-a9d2-b54b8ff5d559 req-acda3ac7-61b2-42ad-9504-b56a8482dd85 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Refreshing instance network info cache due to event network-changed-dd8613d1-ea36-4a21-be5e-298277e66668. {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1df13cb8-c66d-418f-a9d2-b54b8ff5d559 req-acda3ac7-61b2-42ad-9504-b56a8482dd85 service nova] Acquiring lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1df13cb8-c66d-418f-a9d2-b54b8ff5d559 req-acda3ac7-61b2-42ad-9504-b56a8482dd85 service nova] Acquired lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-1df13cb8-c66d-418f-a9d2-b54b8ff5d559 req-acda3ac7-61b2-42ad-9504-b56a8482dd85 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Refreshing network info cache for port dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:20:46 user nova-compute[73476]: INFO nova.compute.manager [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Terminating instance
Aug 26 21:20:46 user nova-compute[73476]: DEBUG nova.compute.manager [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Start destroying the instance on the hypervisor. {{(pid=73476) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-ed514ee2-5380-48f7-b96a-6452de396959 req-b5300734-bf0a-4882-bd93-0e8fbcb2991d service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received event network-vif-unplugged-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ed514ee2-5380-48f7-b96a-6452de396959 req-b5300734-bf0a-4882-bd93-0e8fbcb2991d service nova] Acquiring lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ed514ee2-5380-48f7-b96a-6452de396959 req-b5300734-bf0a-4882-bd93-0e8fbcb2991d service nova] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-ed514ee2-5380-48f7-b96a-6452de396959 req-b5300734-bf0a-4882-bd93-0e8fbcb2991d service nova] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-ed514ee2-5380-48f7-b96a-6452de396959 req-b5300734-bf0a-4882-bd93-0e8fbcb2991d service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] No waiting events found dispatching network-vif-unplugged-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG nova.compute.manager [req-ed514ee2-5380-48f7-b96a-6452de396959 req-b5300734-bf0a-4882-bd93-0e8fbcb2991d service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received event network-vif-unplugged-dd8613d1-ea36-4a21-be5e-298277e66668 for instance with task_state deleting. {{(pid=73476) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-1df13cb8-c66d-418f-a9d2-b54b8ff5d559 req-acda3ac7-61b2-42ad-9504-b56a8482dd85 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updated VIF entry in instance network info cache for port dd8613d1-ea36-4a21-be5e-298277e66668. {{(pid=73476) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG nova.network.neutron [req-1df13cb8-c66d-418f-a9d2-b54b8ff5d559 req-acda3ac7-61b2-42ad-9504-b56a8482dd85 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updating instance_info_cache with network_info: [{"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-1df13cb8-c66d-418f-a9d2-b54b8ff5d559 req-acda3ac7-61b2-42ad-9504-b56a8482dd85 service nova] Releasing lock "refresh_cache-516bc7a5-b90d-4a09-ab6b-1128a88a3afe" {{(pid=73476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:20:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [-] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Instance destroyed successfully.
Aug 26 21:20:47 user nova-compute[73476]: DEBUG nova.objects.instance [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lazy-loading 'resources' on Instance uuid 516bc7a5-b90d-4a09-ab6b-1128a88a3afe {{(pid=73476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.vif [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-242795097',display_name='tempest-TestVolumeBootPattern-server-242795097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-242795097',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp0nGdKWqt25Vovv//zECtWPkdETKJV26I8dVi13Vaw97KRWRRvyx63r4FOvfGKO/4n655MVUFeORvL2Dj2aVlVmOVr7QUBY9FdJPdc/33XGtLV0TAuage04axfNiAeSg==',key_name='tempest-TestVolumeBootPattern-1669868756',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1962b32d78d4f6da29bb0fdaa001363',ramdisk_id='',reservation_id='r-fxa08yjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-443030295',owner_user_name='tempest-TestVolumeBootPattern-443030295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:15:57Z,user_data=None,user_id='5bb1fc1180d34eb0ae98c52187aae87e',uuid=516bc7a5-b90d-4a09-ab6b-1128a88a3afe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converting VIF {"id": "dd8613d1-ea36-4a21-be5e-298277e66668", "address": "fa:16:3e:a0:b1:32", "network": {"id": "0d7be8c6-e12e-4272-86fe-6c6eb06a300e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1536477137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1962b32d78d4f6da29bb0fdaa001363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8613d1-ea", "ovs_interfaceid": "dd8613d1-ea36-4a21-be5e-298277e66668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG nova.network.os_vif_util [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=dd8613d1-ea36-4a21-be5e-298277e66668,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8613d1-ea') {{(pid=73476) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_vif [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=dd8613d1-ea36-4a21-be5e-298277e66668,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8613d1-ea') {{(pid=73476) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd8613d1-ea, bridge=br-int, if_exists=True) {{(pid=73476) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:20:47 user nova-compute[73476]: INFO os_vif [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:b1:32,bridge_name='br-int',has_traffic_filtering=True,id=dd8613d1-ea36-4a21-be5e-298277e66668,network=Network(0d7be8c6-e12e-4272-86fe-6c6eb06a300e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd8613d1-ea')
Aug 26 21:20:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] calling os-brick to detach iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f25d02a0ee0>, {'target_iqns': ['iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcZJKLou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:20:47 user nova-compute[73476]: WARNING os_brick.initiator.connectors.base [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d', 0)] {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e457635-cd93-4adb-b073-bbe9661792d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[d005f47f-c3ab-455a-a554-9431796dc5bb]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:20:47 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d (non-flash)
Aug 26 21:20:47 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f25b056c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d'): ({'sdc'}, set())}) {{(pid=73476) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Removing single pathed devices sdc {{(pid=73476) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[33936686-25b2-46c4-9584-be5d6463dbde]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f172f0-4113-4720-9b92-a8d78982f998]: (4, ('ok\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Flushing IO for device /dev/sdc {{(pid=73476) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4b76d2-999f-41fb-b22f-1c748c0a029e]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73476) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[b228beda-c241-4ef8-a336-b83ea08b2790]: (4, ('1', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.linuxscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] SCSI volumes sdc have been removed. {{(pid=73476) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d')] {{(pid=73476) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf81dc53-7f25-4069-a33e-8f1b32b03855]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --logout {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[e184ebb8-00a5-4863-96af-035649121d75]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260]
Aug 26 21:20:47 user nova-compute[73476]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d, portal: 172.16.0.220,3260] successful.
Aug 26 21:20:47 user nova-compute[73476]:  stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op delete {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1edaf07-8b67-473a-b42c-800fffb2379d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7c58c4-6e66-47cd-95ac-9c11d3d18025]: (4, ('', '')) {{(pid=84820) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73476) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.base [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] <== disconnect_volume: return (252ms) None {{(pid=73476) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Disconnected iSCSI Volume {{(pid=73476) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:20:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Deleting instance files /opt/stack/data/nova/instances/516bc7a5-b90d-4a09-ab6b-1128a88a3afe_del
Aug 26 21:20:47 user nova-compute[73476]: INFO nova.virt.libvirt.driver [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Deletion of /opt/stack/data/nova/instances/516bc7a5-b90d-4a09-ab6b-1128a88a3afe_del complete
Aug 26 21:20:47 user nova-compute[73476]: INFO nova.compute.manager [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 21:20:47 user nova-compute[73476]: DEBUG oslo.service.loopingcall [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73476) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG nova.compute.manager [-] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Deallocating network for instance {{(pid=73476) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:20:47 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] deallocate_for_instance() {{(pid=73476) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:20:48 user nova-compute[73476]: DEBUG nova.network.neutron [-] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Updating instance_info_cache with network_info: [] {{(pid=73476) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:20:48 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Took 1.23 seconds to deallocate network for instance.
Aug 26 21:20:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-e5961d62-bdb8-4d38-87ef-0199af8f2577 req-707b9ded-92b6-489d-992f-7ccd94b5c6a2 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received event network-vif-deleted-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:20:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-949c71bb-2641-4ee7-b01a-650fda594490 req-1af980fb-e04a-4887-9234-71043c7ec051 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received event network-vif-plugged-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:20:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-949c71bb-2641-4ee7-b01a-650fda594490 req-1af980fb-e04a-4887-9234-71043c7ec051 service nova] Acquiring lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:20:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-949c71bb-2641-4ee7-b01a-650fda594490 req-1af980fb-e04a-4887-9234-71043c7ec051 service nova] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:20:48 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [req-949c71bb-2641-4ee7-b01a-650fda594490 req-1af980fb-e04a-4887-9234-71043c7ec051 service nova] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:20:48 user nova-compute[73476]: DEBUG nova.compute.manager [req-949c71bb-2641-4ee7-b01a-650fda594490 req-1af980fb-e04a-4887-9234-71043c7ec051 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] No waiting events found dispatching network-vif-plugged-dd8613d1-ea36-4a21-be5e-298277e66668 {{(pid=73476) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:20:48 user nova-compute[73476]: WARNING nova.compute.manager [req-949c71bb-2641-4ee7-b01a-650fda594490 req-1af980fb-e04a-4887-9234-71043c7ec051 service nova] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Received unexpected event network-vif-plugged-dd8613d1-ea36-4a21-be5e-298277e66668 for instance with vm_state active and task_state deleting.
Aug 26 21:20:49 user nova-compute[73476]: INFO nova.compute.manager [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Took 0.76 seconds to detach 1 volumes for instance.
Aug 26 21:20:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:20:49 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:20:49 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:20:49 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:20:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:20:50 user nova-compute[73476]: INFO nova.scheduler.client.report [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Deleted allocations for instance 516bc7a5-b90d-4a09-ab6b-1128a88a3afe
Aug 26 21:20:50 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-af6fd45a-2a4d-4248-bc54-a94318d5bc1e tempest-TestVolumeBootPattern-443030295 tempest-TestVolumeBootPattern-443030295-project-member] Lock "516bc7a5-b90d-4a09-ab6b-1128a88a3afe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.822s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:20:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:20:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:20:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:20:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:20:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:20:58 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:21:01 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:21:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:21:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:21:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:21:02 user nova-compute[73476]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693084847.0622275, 516bc7a5-b90d-4a09-ab6b-1128a88a3afe => Stopped> {{(pid=73476) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:21:02 user nova-compute[73476]: INFO nova.compute.manager [-] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] VM Stopped (Lifecycle Event)
Aug 26 21:21:02 user nova-compute[73476]: DEBUG nova.compute.manager [None req-d8fd2a60-dd30-44fe-829a-792483ce2d27 None None] [instance: 516bc7a5-b90d-4a09-ab6b-1128a88a3afe] Checking state {{(pid=73476) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:21:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:21:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:21:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:21:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:21:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:21:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:21:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:21:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:21:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.12960433959961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:21:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:21:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:21:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:21:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:21:03 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:21:03 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:21:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:21:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:21:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:07 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:21:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:14 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:21:14 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:21:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:21:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:21:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:21:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:21:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:21:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:21:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:21:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:46 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:50 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:56 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:21:56 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:21:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:21:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:21:59 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:01 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:22:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:22:01 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:22:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:22:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:22:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:22:02 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:22:02 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:22:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:22:03 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:22:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=25.127887725830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:22:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:22:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:22:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:22:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:22:03 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:22:03 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:22:03 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:22:03 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:22:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:22:07 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:11 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:22:14 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:16 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:22:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:22:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:22:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:22:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:22:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:22:45 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:22:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:22:52 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:22:57 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:22:57 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:57 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73476) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 21:22:58 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:22:58 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73476) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:22:59 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:00 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:23:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:23:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:23:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:23:02 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:02 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:03 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Starting heal instance info cache {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:23:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Rebuilding the list of instances to heal {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:23:03 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Didn't find any instances for network info cache update. {{(pid=73476) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:23:04 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:23:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:23:04 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:23:04 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Auditing locally available compute resources for user (node: user) {{(pid=73476) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:23:05 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:23:05 user nova-compute[73476]: WARNING nova.virt.libvirt.driver [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.126483917236328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73476) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73476) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing inventories for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating ProviderTree inventory for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Updating inventory in ProviderTree for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing aggregate associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, aggregates: None {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Refreshing trait associations for resource provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=73476) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.compute.provider_tree [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed in ProviderTree for provider: b505444b-68ee-4bd2-bfa2-81c3d587cc2d {{(pid=73476) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.scheduler.client.report [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Inventory has not changed for provider b505444b-68ee-4bd2-bfa2-81c3d587cc2d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73476) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG nova.compute.resource_tracker [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Compute_service record updated for user:user {{(pid=73476) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:23:05 user nova-compute[73476]: DEBUG oslo_concurrency.lockutils [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=73476) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:23:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:23:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73476) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:23:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:23:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73476) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:23:07 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:08 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:12 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:14 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:14 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:17 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:17 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:22 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:25 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:26 user nova-compute[73476]: DEBUG oslo_service.periodic_task [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73476) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:23:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] Cleaning up deleted instances {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 21:23:26 user nova-compute[73476]: DEBUG nova.compute.manager [None req-cf4bb4f7-2e90-4c95-916e-40a2dd42a9e0 None None] There are 0 instances to clean {{(pid=73476) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 21:23:27 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:32 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:37 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:23:42 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:23:47 user nova-compute[73476]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73476) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}